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ABSTRACT 

Network flows is an important subfield of Operations Research and is well- 
known for its diverse applications and highly efficient algorithms. Applications of 
network flow models have been identified in a variety of situations including 
applied mathematics, communication systems, defense, manufacturing and 
production, scheduling, and public policy. In the recent past, researchers have made 
efforts to identify, compile and summarize those applications which can be 
transformed into fundamental network flow problems such as shortest paths, 
maximum flows, minimum cost flows, assignments and minimum spanning trees, 
etc. This thesis addresses a similar issue and attempts to identify the applications of 
network flow models in Lagrangian relaxation. 

Lagrangian relaxation is an important technique in combinatorial 
optimization and is extensively used in designing branch and bound algorithms for 
hard (i.e., NP-complete) problems. The relaxed problems obtained by applying the 
Lagrangian relaxation technique are often network flow problems and, therefore, 
can be very efficiently solved by network flow algorithms. 

In this work, we make an attempt to identify and summarize such 
applications whose Lagrangian relaxation results in network flow subproblems. We 
report over 40 applications which have been selected through an extensive research 
of the available literature. These also include some applications which we have 
formulated ourselves. We hope that the understanding of the models described 
here will allow researchers to identify more and more hard optimization problems 
whose lower bounds can be obtained more efficiently by using network flow 
algorithms in Lagrangian relaxation. 
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CHAPTER 1 


INTRODUCTION 


1.1 INTRODUCTION 

Network flows is an important area in linear programming and is known for 
its novel theoretical properties. For most of the network flow problems, very 
efficient algorithms have been developed by exploiting the structure of the 
constraint matrix. However, many real life and practical problems can be viewed as 
easy network flow problems complicated by a relatively small set of side constraints. 
These problems can not be modeled as pure network flow problems and are difficult 
to solve because direct algorithms are not available for such constrained network 
flow problems. 

Lagrangian relaxation is a flexible solution strategy that permits to exploit 
underlying special structure in any optimization problem by relaxing complicated 
constraints. This approach permits to "pull apart" constrained network flow 
problems by removing complicating non-network constraints and instead place 
them in the objective function with associated Lagrangian multipliers. Dualizing 
these complicating side constraints using the Lagrangian relaxation technique 
produces Lagrangian subproblem (or subproblems) that is a pure network problem 
in nature. This Lagrangian subproblem can be solved as a pure network flow 
problem and its optimal value will be a lower bound (for minimization problem) 
on the optimal value of the original constrained network flow problem. Many 
practitioners identified various applications of such hard combinatorial 
optimization problems which have two sets of constraints, one set of "network" 
constraints and the other of non-network "side" constraints. These applications are 
few in number and appear to be scattered in the literature. 

Though Fisher [1981], and Ahuja, Orlin and Magnanti [1993] gave a 
compilation of few such applications, yet there is no single paper, or any other 
reference that summarizes all such real life applications at one place. This report 
fills precisely this need by describing, summarizing or simply referencing more than 
40 such combinatorial optimization problems in which by relaxing complicating 
non-network constraints, we can get pure network flow Lagrangian subproblems. 
Furthermore, we also tried to identify and add some applications of similar nature 
in this report. The network flow problems, which arise as Lagrangian subproblems 
in such relaxed hard combinatorial optimization problems, are : 



(i) The shortest path problem. 

(ii) The minimum spanning tree problem. 

(iii) The minimum cost flow problem. 

(iv) The assignment problem. 

(v) The maximum flow problem. 

Identifying such constrained network flow application or combinatorial 
optimization problems with two sets of constraints, proved to be a difficult task. 
Since there existed no reference on such applications, we almost had to survey the 
entire combinatorial optimization/network flows area. 

This work was started as a project last year on the same topic by Garg [1993] as his 
M. Tech, thesis. More than 40 applications were collected and reported in that 
project. This thesis is in continuation of the aforesaid project and collects over 40 
applications, which are non-overlapping with those reported in the previous work. 
In the first phase, we went over the papers cited in the Integer Programming 
Bibliographies (Kasting [1976] and Hausman [1978] ) xmder the subjects lying within 
relaxation, network flows and integer programming. We also went through the 
International Abstracts of Operations Research in above areas. We then scanned 
these papers to identify such applications. We also scanned the papers given in the 
reference list of above identified papers. In the second phase, we went through 
many journals in management science, operations research, mathematics and 
communications where such articles are likely to have appeared in the past. We 
also thought and added some additional applications in this phase. 

During our research, the applications we found, could be categorized into two 
broad classes : 

(i) Applications whose Lagrangian relaxation resulted into one single pure 
network flow problem. 

(ii) Applications whose relaxation resulted into more than one, different type of 
pure network flow subproblems. 

We have included in our report most of the such applications that were 
interesting, simple to describe and would throw insight on modeling and relaxing 
techniques. We have kept the readability and the importance of an application in 
mind while deciding about its inclusion in the text. There was another category of 
applications that were nice but either too related to the applications to be described 
completely or rather too simple to be discussed fully. For such applications, we only 



describe the problem. To summarize, the applications identified are covered in this 
report in the following three manners : 

(i) The problem is described and its formulation is shown. By using Lagrangian 
relaxation, resulting pure network flow subproblem (or subproblems) is 
shown for such application. 

(ii) The problem is described and its equivalence with previously described 
problem has been proved. 

(iii) The problem is simply stated with no description of the model given, because 
of the complexity of the problem. 

1.2 NOTATION AND DEFINITION 

We now collect several basic definitions and describe some notations. We 
consider a directed graph G = (N, A) consisting of a set, N, of nodes, and a set. A, of 
arcs whose elements are ordered pairs of distinct nodes. A directed network is a 
directed graph with numerical values attached to its nodes and/or arcs. We let n = 
|N| and m = iA|. We associate with each arc (i, j) e A, a cost qj and a capacity Ujj > 0 . 

Frequently, we distinguish two special nodes in a graph : the source s and sink t. 

An arc (i, j) has two end points, i and j. We refer to node i as the tail and node 
j as the head of arc (i, j) and the arc (i, j) is incident to nodes i and j. The arc (i, j) is 
an outgoing arc of node i and an incoming arc of node j. The arc adjacency list of 
node i, A(i), is defined as the set of arcs emanating from node i, i.e., A(i) = {(i, j) € A: 
j € N}. The node-arc incidence matrix representation, or simply the incidence 
matrix representation, represents a network as the constraint matrix of the problem. 
This representation stores the network as an nxm matrix N which contains one 
row for each node of the network and one column for each arc. The column 
corresponding to arc (i, j) has only two nonzero elements : it has a+1 in the row 
corresponding to row i and a-1 in the row corresponding to row j. The degree of a 
node is the number of incoming and outgoing arcs incident to that node. 

A directed path in G = (N, A) is a sequence of distinct nodes and arcs ij, (i^, 12), 
h' ^3^' 13/—// (if-ir ir satisfying the property that (ij^, e A for k = l,...,r-l. An 
undirected path is defined similarly except that for any two consecutive nodes i^. and 
ik+i on the path, the path contains either the arc (i^/ i^+i) or the arc (1^+1/ ik^- ^ 
directed cycle is a directed path together with the arc (ij., i|) and an undirected cycle 
is an undirected path together with the arc (ij., i|) or (i^, ij.). 



We shall often use the terminology path to designate either a directed or an 
undirected path, whichever is appropriate from context. For simplicity of notation, 
we shall often refer to a path as a sequence of nodes - ^2 " — ■ ifc its arcs are 

apparent from the problem context. Alternatively, we shall sometimes refer to a 
path as a set of (sequence of) arcs without any mention of the nodes. We shall use 
similar conventions for representing cycles. 

A graph G = (N, A) is called a bipartite graph if its node set N can be 
partitioned into two subsets N| and N 2 so that for each arc (i, j) in A, i e Nj and j e 

N2- 


A graph G' = (N', A') is a subgraph of G = (N, A) if N' C N and A' £ A. A 
graph G' = (N', A') is a spanning subgraph of G = (N, A) if N' = N and A’ c A. 

Two nodes i and j are said to be connected if the graph contains at least one 
undirected path from i to j. A graph is said to be connected if all pairs of its nodes 
are connected; otherwise, it is disconnected. The connected subgraphs of a graph are 
called its components. We always assume that the graph G is connected and hence 
m > n-1. 

1.3 NETWORK FLOW PROBLEMS 

We shall now briefly describe the network flow problems which arise as 
Lagrangian subproblems in the relaxed problems considered in this thesis. 


Shortest Path Problem 


The shortest path problem is to determine directed paths of smallest cost from 
a given node s to all other nodes in the network. The problem can be stated as the 
following linear programming problem : 


Minimize 


E 

(i peA 


"ij 


subject to 


S ^ij - X 

{j:(i , j)€ A {j:(j, i)e A 


(n-1) for i = s 
-1 forieN-js} 


Xjj > 0 for all (i, j) e A 



Some of the simplest applications of the shortest path problem are to 
determine a path between two specified nodes of a network that has a minimum 
length, or a path that takes least time to traverse, or a path that has the maximum 
reliability. 

Assignment Problem 

The data of the assignment problem consists of a set, N|, say of persons and a 
set N 2 , say of objects, satisfying jNjj = |N 2 |, a collection of node pairs A £ N| x N 2 
representing possible person-to-object assignments, and a cost Cjj associated with 
each element (i, j) in A. The objective is to assign each person to exactly one object 
in a way that minimizes the total cost of assignment. This problem can be stated as 
the following linear program: 

Minimize V c.-.- x,; 

Z-r 1) I] 

(i j)6 A 


subject to 

2 xjj = 1 for all i e Ni , 

{j:(i , j)€ A) 

Xjj = 1 for all j e N 2 , 

{j:(i, jjeA} 

Xjj > 0 for all (i, p € A. 

Sometimes, we have a utility Ujj assigned with each arc (i, j) e A and our objective is 

to obtain an assignment that maximizes the total utility ^ u-. Xj.. We can 

(i j)€ A 

transform this problem to the previous version by defining Cjj = - Ujj and 

minimizing the objective ^ Cjj xjj. 

(i j)e A 

The applications of the assignment problem include assigning people to 
projects, jobs to machines, tenants to apartments, swimmers to events in a 
swimming meet, and medical school graduates to available internships. 

Minimum Spanning Tree Problem 

A spanning tree is a connected acyclic graph that spans all the nodes of an 
undirected network. The cost of a spanning tree is the sum of the costs of its arcs. In 



the minimum spanning tree problem, we wish to identify a spanning tree of 
minimum cost. 


Minimum Cost Flow Problem 


We wish to determine a least cost shipment of a commodity through a 
network that will satisfy demands at certain nodes from available supplies at other 
nodes. The problem can be stated as the following linear programming program: 


Minimize 


I 

(i j)e A 


c-- x- • 

1] n 


subject to 


X ^ii ■ X 

{j:(i,j)€A i)€A 

^ ij - 

In this problem, Cjj represents the cost per imit flow on arc (i, j), I jj represents 
the lower bound on the arc flow and Ujj represents upper bound on arc flow. The 
number b(i) represents the supply /demand of a node ieN. If b(i) > 0, then node i is a 
supply node; if b(i) < 0 then node i is a demand node; and if b(i) = 0 then it is a 
transshipment node. 

The applications of minimum cost flow problem include : the distribution of 
a product from manufacturing plants to warehouses, or from warehouses to 
retailers; the flow of raw material and intermediate goods through the various 
machining stations in a production line; the routing of automobiles through an 
urban street network; and the routing of calls though the telephone system. 

Maximum Flow Problem 

To define the maximum flow problem, we distinguish two special nodes in 
the network G: a source node s and a sink node t. We wish to find maximum flow 
from s to t that satisfies the arc capacities and mass balance constraints at all nodes. 
The problem is stated formally as follows : 

Maximize v 


subject to 



{j:(i , j)e A i)e A 


v for i=s 
0 for all ieN-{s t} 
-V for i=t 


0 < Xjj Ujj for each (i, p e A 

The applications of the maximum flow problem include : feasible flow 
problem, matrix rounding problem, scheduling on uniform parallel machines, 
distributed computing on a two-processor computer, etc. 


1.4 OVERVIEW OF THE THESIS 


In Chapter 2, we describe the Lagrangian Relaxation technique and related 
properties and theorems. In Chapter 3, we describe applications in which relaxed 
Lagrangian subproblems are shortest path problems. Chapter 4 includes applications 
in which relaxed Lagrangian subproblems are maximum flow problems. Chapter 5 
describes the applications in which relaxed problems are minimum cost flow 
problems. In Chapter 6, we describe applications in which relaxed problems are 
assignment problems. In Chapter 7, we describe applications whose Lagrangian 
relaxation results in more than one Lagrangian network flow subproblems. In 
addition to these, we also report the additional applications in which Lagrangian 
subproblems will be network flow problems other than the above defined classes. 
Chapter 8 contains conclusions and direction for future research. 

We have mentioned references beside each application. We have not 
mentioned any reference beside the applications which we have formulated 
ourselves. 
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CHAPTER 2 

LAGRANGIAN RELAXATION 

2.1 INTRODUCTION 

Combinatorial optimization problems arise in two situations. There is a 
small number of easy problems which can be solved in time bounded by a 
polynomial in the input length and an all-too-large class of "hard problems" for 
which all known algorithm require exponential time in the worst case. Many hard 
problems can be viewed as easy problems complicated by a relatively small set of 
constraints. 

Lagrangian relaxation is a solution strategy that dualizes side constraints and 
produce a Lagrangian subproblem that is easy to solve and whose optimal value is a 
lower bound (for minimization problem) on the optimal value of the objective 
function of the original problem. The Lagrangian relaxation can then be used in 
place of a linear programming relaxation to provide bounds in a branch and bound 
algorithm. 

2.2 LITERATURE SURVEY 

The Lagrangian multiplier technique of nonlinear optimization dates back to 
the 1700s and was originated by the famous mathematician Lagrange, after whom 
the technique is named. There were a number of forays prior to 1970 into the use of 
Lagrangian methods in discrete optimization, including the Everett's proposal for 
"generalizing" Lagrange multipliers (1963). The "birth" of the Lagrangian approach 
as it exists today, however, occurred in 1970 when Held and Karp (1971) used a 
Lagrangian problem based on minimum spanning trees to devise a dramatically 
successful algorithm for the travelling salesman problem. This work was not only 
an eye-opening successful application, but also set out many key ideas in applying 
the Lagrangian relaxation method to integer programming problems. Fisher (1981) 
and Geoffrion (1974) provide insightful surveys of Lagrangian relaxation and its 
uses in integer programming. Orlin and Bertsimas (1991) have developed the most 
efficient algorithms (in the worst case) for many classes of Lagrangian relaxation 
problems. Belling-Seib, Meyer and Muller (1988) have compared Lagrangian 
relaxation technique for solving the constrained network flow problems with other 
techniques (primal simplex algorithm and dual method). 
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2.3 LAGRANGIAN RELAXATION TECHNIQUE 

To describe the general form of the Lagrangian relaxation procedure, we begin 
with the following combinatorial optimization model formulated in terms of a 
vector X of a decision variables : 

Z* = minimize CX (P) 

subject to 

AX<b, (2.2a) 

XeX ' (Z2b) 

The model has a linear objective function CX and a set AX < b of explicit 
linear constrains. The decision variables X are also constrained to lie in a given 
constraint set X = [X:N X = q, 0 < X < u}, which might be all the feasible solutions to 
a network flow problem with a supply /demand vector q. We further assume that X 
is finite. 

Lagrangian relaxation procedure uses the idea of relaxing explicit constraint 
set (2.2a) by bringing them into the objective function by associating a Lagrangian 
multiplier vector ji. The resulting problem will be 

minimize (CX + p (AX - b)) (L) 

subject to X e X . 

We can refer to the function 

L(p) = min {CX + p(AX - b) : X e X }, (2.2c) 

as the Lagrangian function. 

If the constraint set (2.2a) is less than or equal to type of constraint, then p will 
be restricted to the non-negative, i.e., p > 0 ; if it is equality constraint set (AX = b), 
then p will be unrestricted in sign; otherwise if constraint set (2.2a) is greater than or 
equal to type of constraint (AX > b), then p will be restricted to be negative i.e., p < 0. 

Theorem 2.1 : (Lagrangian Bounding Principle), For non-negative Lagrangian 
multipliers p > 0 associated with constraint set (2.2a), i.e., AX S' b, the value L(p) of 
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the Lagrangian function (2.2c) is a lower bound on the optimal objective function 
value Z* of the original optimization problem (P). 

Proof : Since AX < b for every feasible solution to (P) and for non-negative 
Lagrangian vector set |i > 0, the result will be : 

Up.) < CX* + piAX* - b) < (CX* = Z*). 

We assume that X* is an optimal solution to (P). As (AX*- b) will be either 
zero or less than zero for an optimal solution X* to (P), for \i>0, |i(AX*-b) will be 
either zero or negative. Hence L(ji) will be a lower bound on the optimal value Z* 
for the original optimization problem. To get the sharpest possible bound, we 
would need to solve the following optimization problem : 

L* = max L(|i), 

|i>0 

which we refer to as Lagrangian multiplier problem associated with the original 
optimization problem (P). The Lagrangian bounding principle has the following 
implications. 

Theorem 2.2 : (Weak Duality Theorem). The optimal objective function L* of the 
Lagrange multiplier problem is always a lower bound on the optimal objective 
function value of the problem (P), i.e., L*< Z*. ♦ 

Theorem 2.3 ; If for some choice of the Lagrangian multiplier (fj. > 0), the solution 
X*o/ the Lagrangian relaxation (i) is feasible in the optimization problem (P), and (ii) 
satisfies the complementary slackness condition p(AX*-b) = 0, then X* is an optimal 
solution of the original optimization problem (P). 

Proof : By assumption L(|i) = CX* + |i(AX* - b). Since |i(AX* - b) = 0, L(|i) = CX* and 
the solution X* is feasible to the optimization problem (P), i.e., AX* < b. Hence, X* is 
an optimal solution to the optimization problem (P). ♦ 

The above mentioned properties and theorems show that certain solutions of 
the Lagrangian subproblems provably solve the original problem (P). From this, we 
arrive at two properties : 

Property 2.1 ; Solutions to the Lagrangian subproblem (L) that are feasible, but are 
not provably optimal for the original problem (P). 
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Property 2.2 : Solution to the Lagrangian subproblem (L) are not feasible to original 
problem (P). 

In the first case (Property 2.1), branch and bound procedures can be used to get 
the sharpest possible bound. Fisher (1981) provided an insight about the use of 
Lagrangian problem in place of linear programming relaxation to provide bounds in 
branch and bound algorithms. In the second case, for many applications, researchers 
have been able to modify "modestly" infeasible solutions so that they become 
feasible with only a slight degradation in the objective function value by using some 
heuristic methods. 

Subgradient Optimization 

The following issue is related with the solution procedure of the Lagrangian 
multiplier problem (L) : How to find out the optimal multiplier value (p*) of the 
Lagrangian multiplier problem (L), i.e., we need to find the highest point of the 
Lagrangian multiplier function L(p). 

For our optimization model (P) defined as {CX : AX < b, X e X }, we assume 
that the set X = {X^, X2,...,X*^} is finite. By relaxing the constraints AX < b, we obtain 
the Lagrangian multiplier function L(p) = min {CX + p(AX-b) : X e X }. Thus : 

L(p) < CX^ + p(AXk - b) for all k = 1,...,K. 

The best choice for p would be an optimal solution to the dual problem : 

max CO (D) 

subject to 

CO < CX^^ + p(AX^‘ - b) for all k = 1,...,K. 

p>0. 

The above linear program (D) can be solved by applying linear programming 
methodology. Dantzig-Wolfe decomposition or generalized linear programming is 
an important solution strategy to solve the linear program (D). It has been discussed 
by Ahuja, Magnanti and Orlin (1993). However, one of the disadvantages of this 
approach is that it requires the solution of a series of linear programs which are 
rather expensive computationally. 
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Another approach to find the optimal value of Lagrangian multipliers might 
be to apply gradient method to the Lagrangian function L(|i). The function L(p) has 
all properties like continuity and concavity except one-differentiability. The 
function [L(jj,)] is one-differentiable at any |i, where it has two or more solutions. For 
solving the (non-differentiable) Lagrangian, subgradient optimization technique is 
commonly used. The subgradient method is a brazen application of the gradient 
method in which gradients are replaced by subgradients. Let be any initial choice 
of the Lagrange multiplier; the subsequent values for k = 1 , 2 ,..., of the Lagrange 
multipliers can be determined as follow : 

[^k+l = ^k + 0^(Axk.b)]+ 

In the above expression, is any solution to the Lagrangian subproblem (L) when p 
= p^ and 9j^ is the step length at the kth iteration. As the updated value of one or 

more components of p may become negative, we avoid this possibility by taking 
only the positive value. The notation [Y]"*" denotes the "positive part" of the vector 
y; that is, the ith component of [Y]+ equals the maximum of zero and Y|. 

Held, Wolfe and Crowder (1974) have discussed the computational 
performance and theoretical convergence properties of subgradient optimization in 
detail. The step size 0j^ used commonly in practice is : 

[UB-L(p^^)] 

I KAX^^-b)! |2 

In this expression, UB is an upper bound on the optimal objective function value Z* 
of the problem (P) and it can be any known feasible solution to the problem (P). 


Relationship to Linear Programming 

Two properties are important in evaluating a relaxation ; the sharpness of the 
bound produced and the amount of computation required to obtain these bounds. 
The primary use of the Lagrangian relaxation technique is to obtain lower bounds 
on the objective function values (discrete) optimization problems. By relaxing the 
integrality constraints in the original problem (P), we obtain an alternative method 
for generating lower boimd, known as linear relaxation. 
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Theorem 2.3 : Integrality property : Lagrangian function L(p.) satisfies the integrality 
property if it has an integer optimal solution for every choice of }jl even if we relax 
the integrality restriction on the variable X. 

Fisher (1981) has proved that for problems satisfying the integrality property, 
solving the Lagrangian multiplier problem (L) is equivalent to solving the linear 
relaxation of the problem (P). In these situations, though Lagrangian relaxation 
technique provides no better a bound than the linear programming relaxation, yet 
the Lagrangian relaxation techruque might be of considerable value, because solving 
the Lagrangian multiplier problem (L) might be more efficient than solving the 
linear programming relaxation directly. It will be an efficient solution strategy 
where Lagrangian subproblems are network flow problems. The Lagrangian 
relaxation can exploit the core network substructures - shortest path, minimum cost 
flow, spanning tree, assignment and other problems. Usually, we choose the 
constraints to relax in a way that we can exploit underlying structure of the relaxed 
problem. 

Our work is concentrated to identify all such applications in a variety of areas 
where Lagrangian relaxation of complicating constraints results in network flow 
subproblem (or subproblems). These Lagrangian subproblems can be solved 
efficiently by network flow algorithms for a fixed value of Lagrangian multiplier 
vector and we can get bounds for the optimal solution of the original problem. 
Ahuja, Magnanti and Orlin (1993) presented a literature survey of network flow 
problems and described some of the fastest algorithm for solving these network flow 
problems. 
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CHAPTERS 

APPLICATIONS OF SHORTEST PATH PROBLEM 

In this chapter, we report applications in which the Lagrangian subproblems 
are shortest path problems. The following is the list of applications reported : 


1. Very large scale integrated (VLSI) circuit design. 

(Feo and Hochbaum [1986]) 

2. Survivable network design (SND) testing 
(Feo and Hochbaum [1986]) 

3. Crew scheduling in a mass transit setting 
(Cararessi and Gallo [1986]) 

4. Rostering problem 
(Cararessi and Gallo [1986]) 

5. Resource constrained shortest path problem 
(Beasley and Christofides [1989]) 

6. Rotating workforce scheduling 
(Balakrishnan and Wong [1990]) 

7. Rotating workforce scheduling : Additional applications 

(Balakrishnan and Wong [1990]) 

8. Traveling salesman problem as a shortest path problem with side constraints 
(Shapiro [1991]) 

9. Scheduling of power-generation system 
(Muckstadt and Koenig [1977]) 

10. Multi-item capacitated lot sizing problem 
(Chen and Thizy [1990]) 

11. Allocation of inspection effort on a production line 

Application 3.1 : Very Large Scale Integrated (VLSI) Circuit Design 

Reference : Thomas A. Feo and Dorit S. Hochbaum (1986). 

The demand for electronic circuits has increased rapidly over the past 50 
years. Bell Communications Research, Inc.'s (BELLCORE) interest in VLSI comes 
from their involvement in telephone and communications systems. In this 
industry, integrated circuits that perform specialized high-speed digital switching are 



of great importance. The method presented in this paper fills the important need 
for recognizing infeasibility of certain VLSI routing problems. 

In VLSI chips, the area or size of chip is a factor of great importance. The goal 
of design is to permit the manufacturing of a chip that will be as small as possible. 
For given components (such as arithmetic logic units, memory buffers, and so 
forth), their placement on chip, and their terminal positions, the design problem is 
to find within the given area a routing that will connect disjoint set of terminals. 
This routing must obey certain wiring rules that specify the distances (disjointness) 
between the routing wires. The disjoint sets of terminals to be connected are called 
nets. For such a design, it needs to be determined whether there is a routing that 
obeys all the wiring rules and connects all the disjoint pairs of terminals. 

According to commonly used wiring models, the physical connections 
between the terminals must follow paths along a grid. The routing must not 
coincide along the grid, that is, they are not allowed to share any point on the grid. 
In the context of graphs, each point on the grid is considered a vertex and 
connection between two points an edge. Every path from one vertex, a, to another, 
b, is viewed as an ordered string of vertices, Vj, V 2 ,...,Vj, with V| = a, Vj = b. Given 

k pairs of terminals, the problem translates into finding k vertex disjoint paths in a 
grid-like graph. When the graph is any collection of vertices and edges, the problem 
is known as vertex disjoint path problem (DPP). So the concern is : given a graph G 
containing k disjoint vertex pairs (Sj, tj), (S 2 , t 2 ),...,(sj^, tj^), does the graph G contain k 

vertex disjoint paths, one for each (s, t) pair? 

In the formulation, G is considered as a multicommodity flows network with 
a unique commodity associated with each source-terminal pair. Let Xjjj be the flow 

of commodity 1 from node i along an edge in E to node j. Let n = I V I and k directed 
edges be added to G, each from a q to Sj for i = l,...,k. Now the DPP formulation is as 


Z = max x^.g-i 



subject to 



■ ''ijl ^ = 0 

for i € V, 1 = l,...k 

(3.1a) 

xj, <1 

for i e V 

(3.1b) 

Xjii ={0,1} 

for i, j e V, 1 = 1,..., k 

(3.1c) 



The objective of this formulation is to maximize the sum of flow of k commodities. 
Constraints (3.1a) stipulate that sum of flows of each commodity into a node must 
equal the sum of flows of that commodity out of the node. The constraint (3.1b) is a 
capacity constraint. Constraint (3.1c) is an integrality constraint. 

Note that DPP is a recognition problem, and the answer to this problem is yes 
if and only if Z* = k. Due to the three sets of constraints, every source-terminal pair 
will possess either a unit flow, representing a simple path in G, or no flow. The 
objective function value Z* is the maximum number of vertex disjoint paths 
between the k pairs of vertices in G. If Z* < k, then G does not contain k vertex 
disjoint paths and this is the case that is referred to as infeasible. The Lagrangian 
relaxation presented in this paper follows directly from the previous discussions. 
The linear formulation of DPP is relaxed by moving the capacity constraints (3.1b) 
into the objective function. Let tcj be the nonnegative penalty corresponding to the 

capacity constraints of node i. The Lagrangian relaxation of the vertex disjoint paths 
problem (RDPP) is 

max Xj.. sj:^ + Xj_j tcj (1 - xjjp 

subject to 

(Xjjj - Xjjj ) = 0 for i e V, 1 = l,...k (3.1d) 

Xiji = {0, 1} for i, j € V, 1 = 1,..., k (3.1e) 

Next, we state the following result, as given by the authors : The RDPP can be 
solved by solving k shortest-path problems. 

The proof is given in the paper by Feo and Hochbaum (1986). Thereafter, one 
can proceed in the usual manner using subgradient optimization technique as 
described earlier. 

Application 3.2 ; SND (Survivable network design) Testing 
Reference : Thomas A. Feo and Dorit S. Hochbaum (1986). 

A possible extension to the recognition version of VLSI routing (as described 
in application 3.1) is survivable network design (SND) testing. An SND problem of 
interest to national security is to assess the survivability of a network by the number 



of vertex disjoint paths that remain between key vertices after a given damage 
scenario. Applications of the Lagrangian relaxation method will produce an upper 
bound for making such an assessment. A similar extension is possible for the 
problems that arise in communication networks. 

Application 3.3 : Crew Scheduling in a Mass Transit Setting 
Reference : Carasessi and Gallo (1986). 

It consists of finding a set of duties to be assigned to drivers of vehicles in 
order that the daily service requirements be met at the minimum cost. 

It is assumed here that the vehicle scheduling problem has already been 
solved, and that the set of vehicle duties defining the vehicle schedule is already 
known. The term "block", as is often used in the literature, is used for "vehicle 
duty". For each block a set of relief times , i.e., times at which a driver’s substitution 
may occur, is given. A piece of work is a continuous driving period. Let s(p) and 
e(p) be the starting and ending time respectively of piece of work p. A piece of work 
p is feasible for a block if both s(p) and e(p) are relief times of the block. A duty 
consists of a set of pairs (p, k), where p is a piece of work and k is the block on which 
the piece of work shall be run. Let Tj^, = {t^ , and pj^ with mj^^ = I Pk * denote 

the set of relief times and the set of pieces of work feasible for block k, respectively; 
tj and being the starting and ending times of the block, and let D = {dj, d 2 ,..., d | p | } 

be the set of all feasible duties. 

Set pj^ c p}^ is called a partition of block k : a partition of block is a set of pieces of 
work that cover the service on that block. With the appreciation of partitioning in 
this way, it becomes apparent that the crew scheduling problem boils down to 
finding one partition for each block and then matching together pieces of work from 
the partitions in order to get feasible duties. Out of the many feasible solutions, we 
seek one which minimizes the total cost. 

Associated with each block k, let us define the network Gj^ = (Nj^, A^.), where 
Nj^ = T^. and Aj^ = {s(p), e(p) : p € p^.}; i.e. , each node corresponds to one of the relief 
times, while each arc corresponds to one of the pieces of work feasible for the block; 
ij and being the origin and destination of the network, respectively. 

For instance, consider a block with relief times at 8:30, 9:30, 10:20, 11:20 and 
12:30, and assume that feasible pieces of work have lengths between 1 and 2 hours; 
then the associated network can be shown as in Figure 3.3. 




Figure 3.3. An example timing block 

A partition of block k corresponds to a path from to in Gj^ and vice-versa. 
In the given example, the path (8:30, 9:30, 11:20, 12:30) corresponds to partition 


pj, = {(8:30, 9:30), (9:30, 11:20), (11:20, 12:30)} 

Finally, the crew scheduling problem can be formulated as : 


[P] Minimize cx 


subject to 


"l l = t^ 

- S y?+ S l=tf i=2..(ut-l) 

p€p|,e<p)=i psp^s(p)=l .J 1^,1C 

(3.3a) 

Exj = y?. P6pp,k = l,..r 

(3.3b) 

Bx > a 

(3.3c) 

y*' e (0, l}"^k 

(3.3d) 

xe {0,1}'°' 

(3.3e) 

where c - cost vector 



Ipj(. - subset of all the duty indices corresponding in G to arcs incident to 
nodes (p, k) 

X - vector of binary variables corresponding to the set of all feasible duties. 

ri if the arc corresponds to a piece of work used in the path 
y ~ [0 otherwise 

Constraint (3.3c) is added to take into account peculiarities of the various 
individual problems and matrix ’B’ and matrix 'a' have conformable dimensions. 
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Problem (P) is a rather difficult one, because of the large amount of integer 
variables and constraints, even for small size transportation companies. The 
Lagrangian relaxation of [P] is obtained by multiplying constraints (3.3b) and (3.3c) by 
suitable multipliers and bringing them into the objective function. We get 

(Pr) UK p) = nun [cx - E j. Z p Xpj^( ^ - y f ) - p(Bx-a)] 

subject to 

(3.3a), (3.3d) and (3.3e) , 

where X and p are non-negative multiplier vectors. 

It is assumed that constraints (3.3b) was transformed into > inequality form. 
The relaxed problem is a shortest-path problem with modified costs and L(X, p) 
provides a lower bound to the optimal value of problem (P). The best lower bound 
can be obtained by solving the generalized dual 

Max;t ,,>n L(X,p) 

which can be done by means of subgradient optimization technique, as described 
earlier. 

Application 3.4 : Rostering Problem 
Reference ; Cararessi and Gallo (1986) 

Once a feasible crew schedule has been obtained, a further problem remains to 
be solved, called the rostering problem, which is to assign the duties to actual 
drivers. Depending on the union contract clauses, this can be either a trivial 
problem or a rather difficult one. In most North American Companies, the 
assignment of duties is left to the drivers themselves and the decision is made on 
the basis of seniority, leaving little or no space at all for mathematical modeling. On 
the other hand, there are cases in which the union contract is so binding that in 
order to computerize the rostering procedures, one has to resort to rather 
sophisticated mathematical techniques. This is the case with many European 
companies, where, other things being equal, the objective is set to distribute the 
work load evenly among the drivers. The authors address the last tyq^e of problem 
and propose that network models of vehicle scheduling as modelled in previous 
aoDlication extend to these oroblems as well. 



Application 3.5 : Resoxurce Constrained Shortest Path Problem 

Reference : Beasley and Christofides (1989) 

It is the problem of finding the shortest path between two vertices of a 
network whenever the traversal of an arc/ vertex consumes several resources and 
the resources thus consumed must lie within given limits. The problem can be 
linked to that of a traveller with a budget who has to reach a given destination as 
quickly as possible within the constrains imposed by his budget. The two basic type 
of problems addressed are : 

1. the resource constrained shortest path (RCSP) problem as defined above; and 

2. the vertex constrained shortest path (VCSP) problem, which is the problem of 
finding the shortest path constrained to pass through some specified vertices. 

Note that VCSP can be viewed as a special case of RCSP, i.e., simply associate a 
different resource with each vertex in the set of specified vertices and impose 
appropriate resource limits. Problem formulation is as: 

Consider a network G = (V, A), where V is set of a vertices and A is set of arcs. 
Cjj is length of the arc (i, j) and is infinity if (i, j) ^ A and Cj| = 0 Vie V. 

Jl if arc (i j) is in the optimal path 
~l0 otherwise 

rjjjj = amount of resource k used in traversing arc (i, j) 
qjjj = amount of resource k used in traversing through vertex i 
K = type of resources 
The model is as : 

[P] minZigv^jeV 
subject to 

~ ^ i€ V^je V ^ijk ^ij V ^jk ^ ^ ie V me V ^ ^k 

V k = 1 .. K (3.5a) 


^ ie V ^ij ^ ie V ^ii 


V j 6 V (J56 1, n) 


(3.5b) 



^j€V ^ 


(3.5c) 


Zi,vXi, = l (3.5d) 

Xip(0, 1) yi,j€V (3.56) 


Constraint (3.5a) ensures that the total amount of any resource k used on the 
path should be between Lj^ and Uj^, . Constraint (3.5b) is the degree constraint for 

each node in the network except for origin and destination vertices, while 
constraints (3.5c) and (3.5d) ensure that one arc leaves the origin and one arc enters 
the destination. The Lagrangian relaxation to generate effective lower bounds for 
the above formulation is proposed by relaxing constraints (3.5a) and associating non- 
negative multipliers Sj^ and tj^ with its left-hand and right-hand sides, respectively. 
The relaxed problem Pj^ is as : 


[P^] min 2 jg v^je V ^ k=l ^ ^ ^ijk ^‘lik ^jk^ 


,K 


+ ^k.l (Sfck-tkUfc) 


subject to 

(3.5b), (3.5c), (3.5d) and (3.5e) 

This program is a shortest path problem., the problem of sending a flow of value 
one from vertex to all others subject to flow conservation constraint with a capacity 
limit of one on each arc and the cost of using each arc as the multiplier of Xjj in the 

objective function shown above. 

Application 3.6 : Rotating Workforce Scheduling 
Reference : Balakrishnan and Wong (1990). 

This problem involves the construction of an efficient sequence of work and 
rest periods spanning over a number of weeks. Typical constraints in the 
scheduling process impose upper and lower bounds on the lengths of rest and work 
periods, permit only specific shift changes, and restrict the number of consecutive 
work periods on the same shift. The schedule is so designed that at the end of the 
every cycle of M weeks, where M is the planning horizon, the entire schedule will 
have repeated itself for every worker. The workers would begin on different weeks 



of the sequence, i.e., what worker "i" did in week 1, worker "(i-1)" will do in week 2, 
and so on. Therefore, with this approach, at the end of each cycle, the workload is 
uniformly distributed between the workers and they all will have equally desirable 
schedules. 

In addition to the regular constraints such as lower and upper bounds on the 
length of rest periods, etc, there are complicating staff covering constraints for the 
minimum workforce requirement for each shift of each day of the week. Thus, 
there are 7 S such constraints where S is the number of shifts in a day. These 
constraints are relaxed in a Lagrangian fashion in the solution technique. 

A basic network model could be associated with this problem in the following 

way. 


The first day in the planning horizon corresponds to the source node in the 
network, and similarly the- last day corresponds to the sink node. The arcs in the 
network corresponds to a work period allocated to a specific shift. The network is 
constructed in a way that each path from source to sink will define an alternating 
sequence of work and rest periods. If the length of the path is modeled as the cost of 
that sequence or schedule, then the shortest path gives the best sequence or 
schedule, in terms of cost. An example network for a 4-week, two-shift where the 
work-period length must be between 3 and 7 days, and the rest-period lengths must 

be between 1 and 3 days, is as shown in the Figure 3.6. 

Sift 



Vttlc 

1 ^34 

Fig. 3 jS. Hetmxklbr itrtatmi; ■workfarce acliedtiliiie- 

Note that a series of nodes over each day of the planning is shown for shifts 
as well as rest period. Also, each arc terminating at the shift 1 node define shift 1 
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work period and similar interpretation is for other arcs. Since a rest period shoulc 
be there between any two work periods, any arc originating from first row or seconc 
row terminates in the third row. Dummy arcs have been created between shift 1 
and shift 2 nodes so that a rest period can follow shift 1 work period also 
Alternatively, these can be eliminated and the arcs can be shown to terminate 
directly from first to third row. 

Since there is selective approach for arcs to be included in the network (based 
on various constraints), the network is very sparse. The staffing constraints still 
remain to be taken care of. This is done in the following way. With each arc, 
associate a vector of attributes that will have as many elements as there are temporal 
(staffing) requirements. For a 2-shift problem, there will be 14 such elements. For 
example, an arc indicating a work period from Monday to Friday in the first shift 
will have the vector as (11111 00 0000000). Each arc corresponding to a rest period 
has an associated vector of all zeros. The path between the source and the sink 
should then be such that the attribute vector, summed over all arcs on which flow 
occurs, is greater than or equal to temporal workforce requirements. This is due to 
the fact that the planning horizon is of as many weeks as is the total number of 
workers to facilitate perfect rotation of load. The solution strategy is as follows. To 
find the optimal solution satisfying all the constraints (including temporal 
workforce requirements), it is necessary only to find the shortest path through the 
network that satisfies the temporal constraints. However, the complete 
enumeration of all the paths starting from the shortest path makes it seem 
unpractical. Thus, a two-phase approach is proposed. The first phase is to relax the 
temporal constraints in the Lagrangian fashion and obtain a good lower bound by 
solving the resulting shortest-path subproblem. The second phase uses a heuristic 
algorithm that makes use of the bound generated in the first phase. 

Application 3.7 : Rotating Workforce Scheduling : Additional Applications 

Reference : Balakrishnan and Wong (1990) 

The model and the solution procedure of the Application 3.6 have been 
applied to the following three real-life example that have been quoted in the 
literature earlier. 

(a) Metropolitan Police Department : Rotating Schedules 
(Heller, McWeen and Stenzel (1973)) 



The problem deals with the Evidene Technician Unit from St. Louii 
Metropolitan Police Department which has 17 officers who are assigned rotating 
schedules to staff three nonoverlapping shifts every day of the week. The problem 
has following constraints (i) rest-period length must be between 2 and 7 days; (ii] 
work-period length must be between 3 and 8 days; (iii) a shift cannot be assigned to 
more than 4 consecutive weeks in a row; (iv) shift changes are not allowed after a 
rest period that includes a Sunday or a Monday or both; (v) the only allowable shift 
changes are 1 to 3, 2 to 1, and 3 to 2 and, (vi) a matrix of temporal requirement has 
been provided additionally. The solution technique of Balakrishnan and Wong 
yields smoother workforce scheduling than the original solution. 

(b) Edmonston Police Department : Manpower Scheduling 
(Butler (1978)) 

This is to solve a scheduling problem in the Edmonton Police Department, 
Canada. There are 9 officers involved, and the temporal requirements call for two 
officers during each shift of every day, except during the second shift of Thursday, 
Friday and Saturday when three officers are needed. Other constraints are (i) work- 
period lengths are between 4 and 7 days; (ii) only shift 1 can precede the rest period 
preceding a shift 3 work period; (iii) before and after weekend off, only shift 3 and 
shift 2 work-periods are allowed; (iv) at least two consecutive days must be assigned 
to the same shift, and (v) no more than two 7-day work periods are allowed and 
these work-periods should not be consecutive. The solution technique of 
Application 3.6 was applied successfully to this problem as well with provisions 
made in the network to accommodate additional constraints. 

(c) Laporte etaL's Police Manpower Scheduling Problem 
(Laporte, Nobert and Biron (1980)) 

The use of integer programming is illustrated to solve the police manpower 
scheduling problem. There are three nonoverlapping shifts and the constraints in 
this problem specify that (i) rest periods should be at least two days off; (ii) work 
periods must be between 2 and 7 days if the shift is 1 or 2 and between 4 and 7 days if 
work is done in shift 3; (iii) shift changes can occur only after a day off; (iv) schedules 
should contains as many weekends as possible; (v) weekends off should be 
distributed throughout as evenly as possible; (vi) long (short) work-periods should 
be followed by long (short) rest periods, and (vii) work periods of 7 days length are 
preferred in shift 3. The temporal requirements specify that two workers are 


required during each shift of every day. In this case also, the solution technique ol 
application number 3.6 yielded better solution than the original problem. 

Application 3.8 : Traveling Salesman Problem (TSP) as Shortest Path Problem with 
Side Constraints 


Reference : Shapiro (1991) 

The traveling salesman problem is easy to state. Starting from his home base, 
node 0, a salesman wishes to visit each of several cities, represented by nodes l,....,n, 
exactly once and return home, doing so at the lowest possible travel cost. Any 
feasible solution to the problem is known as a tour. 

Let Cjj be the arc length (cost) of arc (i, j). The arc lengths need not be 
symmetric, i.e., c^j ^ C|j is allowed. A new node with the label N+1 is introduced 

which is identical with node 0 but corresponds to terminating there. Thus, the arc 
costs Cj = CjQ for all i. A shortest route problem with side constraints represents 

TSP adequately. As illustrated in accompanying figure, for a seven-city problem, the 
nodes (1,..,N) are replicated N times. The distance from node i in replicate t to node 
j in replicate (t+1) is Cjj. Therefore, TSP can be expressed as the problem of sending 

one unit of flow from node 0 to node N+1 in the expanded network so that the 
distance traveled is minimized (a shortest-route problem), but with the additional 
constraint that each city must be visited exactly once. 



Fig. 3.8. An example tour for Travelling Salesman Problem. 


An example tour could be as shown in Figure 3.8. Let Xjjj (i j) denote the 
flow variable associated with arc (i, j) from level 't' . The formulation is as : 


V = min E c X + E E E 

j=l t=l i=i 


X + r c X 

i j t ^ i ,N<- 1 i . N + l.Ni 
1 = 1 



subject to 


-t 


(3.8a) 

+ ^ji = o 

AT i = 1 .. N 

(3.8ba) 

yN N 

"j=l, ^jt ~ 0 

A/' i = 1 .. N, t = 2...N-1 

(3.8bb) 

yN 

"'^k=l. feii ^ki,N-l ^,N+1,N - 0 

il 

(3.8bc) 

yN 

^i=l ^,N+1,N - ^ 


(3.8c) 

yN-1 N 

^jO ^ t=l ^ 

j = 1 .. N 

(3.8d) 

Xj j. = 0 or 1 


(3.8e) 


Constraints (3.8a)-(3.8c) describe the shortest path problem. Constraints (3.8d) 
require that each node be visited exactly once and these are the constraints that 
make the problem combinatorially complex. These constraints are dualized in a 
Lagrangian fashion. Let tcj be the dual variable associated with jth row of (3.8d). 
Then the relaxed problem L®(7c), given as : 


LOW = min (coj-itj )xop + Z“ Z^.,, 


,N 


^i=l ‘^,N+1 ^,N+1,N^ 


subject to 

(3.8a), (3.8b), (3.8c) and (3.8e) 

The relaxed problem is a shortest path problem with arc lengths Cjj adjusted to 
Cjj - TCj , to reflect the relative economy or diseconomy of visiting node j. 

Application 3.9 : Scheduling of Power-Generation Systems 

Reference : Muckstad and Koenig (1977) 

Two major decisions must be made when scheduling the operation of a 
fossil-fuel power generation system over a short time horizon. First, the "unit 
commitment" decision indicates what generating units are to be in use at each point 
in time over the scheduling horizon. This decision must take into account the 
system capacity considerations and the economic implications of starting up or 



shutting down various steam turbines. The "economic dispatch" decision is the 
allocation of the demand for power or system load among the generating units in 
operation at any point in time. The model is as follows. Let = 1 if generating 

tmit 'i' is operating in period 't' and 0 otherwise, for all i = 1...I and t = 1...T, where I 
is the total number of generating units and T is the total number of periods. 

yjj^j is the proportion of the maximum available capacity that is actually 
used throughout period t, while k = l,...,kj and kj is the number of linear segments 
in the total production cost curve for imit i. It is obvious that, 

Yikt > 0 if Xit = 1, 

m^ and are minimum and maximum operating capacities of generator i, 
respectively, is the maximum amount of power that generator i can produce at 
the kth incremental production cost, gjj^. Then the total energy output from 
generator i in period t can be written as 

^ik Yikt 

Let cojj = 1 if unit i is started in period t and 0 otherwise. Similarly, Zj^ = 1 if unit i is 
shutdown in period t and 0 otherwise. 

Cj startup cost for generator i 
dj shutdown cost for generator i 

gj cost of operating generator i at its minimum capacity for 1 hour 
hj number of hours in period t 
Dj demand level in period t 

Rj minimum quantity to be met by planned operating capacity 
Then, the model is as : 

[P] min {q cojt + dj + hj g^ x^^ + E^Li l^ik gik Yikt H 

subject to 

K >‘i. + sill ^‘ik Xik. ) ^ D, for t = 1...T (3.9a) 

I 

r M . X i R for t = 1, . . ,T 

^ lit t 

I = 1 


(3.9b) 



0 ^ Xikt ^ 

AT i,t 

(3.9c) 

“it ^ 

^ ht 

(3.9d) 


^ i,t 

(3.9e) 

©it, Zit > 0 


(3.9f) 

0<Xit <1 


(3.9g) 

X|t integer 


(3.9h) 


Capacity constraints (3.9a) and reserve constraints (3.9b) are the one that link 
the generators and are therefore relaxed in Lagrangian fashion. The relaxed 
problem .y, decomposes into I single-generator subproblems of the form 

[Ry V ] min {q coj^ + d^ + (h^ gj - m^ - m^Xjj 

^ ^k=l ^ik Sik ~ ^ yikt ^ 


subject to 

(3.9c) - (3.9h) 

Each of these subproblems may be solved by a simple dynamic programming 
recursion. However, the special structure of the subproblems permits its 
visualisation as a graph whose nodes represent the operating states of the generator 
in each period. Figure 3.9 shows a graph that could be used for such solutions. 



Fig. 3.9. Basic model state graph 

As shown, the upper state in each period, represents the 'ON' state and the 
lower the 'OFF* state. The transition arcs on the graph represent feasible decisions, 
and the costs associated with these decisions are the arc lengths. A path through this 
graph specifies an operating schedule for the generator and the problem of finding 



the minimum-cost schedule becomes a shortest-path problem on the acyclic state 
graph. 

Application 3.10 : Multi-item Capacitated Lot Sizing Problem 
Reference : Chen and Thizy (1990) 


This problem consists of determining the quantity and the timing of the 
production for several products in a finite number of periods (T), so as to satisfy a 
known demand in each period and minimize the sum of the set-up, production and 
inventory costs without incurring backlogs. A production capacity is imposed in 
each period. The costs may vary for each product and for each period. The model is 
based on a well-known graphic representation of the problem that assigns a node 
per beginning of period (including T+1), and an arc between each pair of nodes (t, 
x+1) representing the possible decision to produce in period t the quantity necessary 
to satisfy the demands of periods t through t. For I products, there will be I such 
graphs. What links them are T capacity constraints. Let x be the decision variable 
corresponding to an arc between nodes t and x+1 for product i, which is also the 
fraction of the demands for periods t through x of product i that is produced in 
period t. 


~ ^T=t ^itx ^itx 
Zit= Zj +E^^,Xit-di^t 


i = L..I, t = 1...T 
^ i = I...I, t = 1...T 


where Xjj. and Zj^ are production and inventory carried of product i in period t, 
respectively. 

Z° initial inventory 


X • • • . 

djj^ = Ej_^ d[j, where is the demand for product i in period j adjusted for initial 
and final inventories. 

Let 


Sjj = production set-up cost for production i in period t 

fjj^ = total cost of producing product in period t to 

satisfy demands for periods t through x, excluding set up costs 

= maximum capacity available in period t 





yjj = { 1 if > 0 ; 0 otherwise } 

where = capacity consumed by the production of one unit of product i. 


Then, the shortest path formulation is as : 


[P] min it j £^1 

^itx ®it yit 


subject to 




Art = 1...T 

(3.10a) 


ATi = 1...I 

(3.10b) 


m = 1...I, t = 2..T 

(3.10 c) 


Ari = l...I,t = l..T 

(3.10d) 

^ * ^itt>0 



Xitx> 0 

AT i=l..T, t = 1..T, T = 1..T 

(3.10e) 

yjt = 0 or 1 

AT i=l..T, t = 1..T 

(3.10f) 


Here constraints (3.10a) are capacity constraints. Constraints (3.10b) and (3.10c) 
are the shortest path equations and (3.10d) are fixed-charge constraints. If we relax 
capacity and fixed-charge constraints, the problem is decomposed into two 
subproblems, in which the problem in Xj^^ variables is a shortest path problem. 

Application 3.11 : Allocation of Inspection Effort on a Production Line 

A production line consists of an ordered sequence of production stages and 
each stage has a manufacturing operation followed by a potential inspection. The 
product enters stage 1 of the production line in batches of size B > 1. As the items 
within a batch move through manufacturing stage, the operations might introduce 
defects. The probability of introducing a defect at stage i is dj. It is assumed that all 

defects are nonreparable and, the defective items are scrapped. After each stage, 
either all or one of the items can be inspected; it is assumed that the inspection 
identifies every defective item. The production line must end with an inspection 
station so that none of the defective items is shipped to the customer. A measure of 



taken to inspect the products in the batch fully upto that stage. It should be apparent 
that with every stage downstream in production, this time tends to be greater. The 
decision problem is to find an optimal inspection plan that specifies at which stages 
the items should be inspected so that the total cost of production and inspection is 
minimized and inspection time is below a certain limit, T. Using fewer inspection 
stations might decrease inspection costs, but will increase production costs since 
some unnecessary work might be performed on some units that are already 
defective. Now, suppose the following cost data is available : 1) pj, the 
manufacturing cost per unit in stage i; 2) f jj, the fixed cost of inspecting a batch after 
stage j, given that the batch was last inspected after stage i and 3) gjj, the variable cost 
per unit for inspecting one item, given that the batch was last inspected after stage i. 

This inspection problem can be formulated as a shortest path problem with 
an additional constraint on inspection time. The network G(N, A) is defined with 
(n+1) nodes, numbered 0...n. The network contains an arc (i, j) for each node pair i 
and j if i < j. Figure 3.11 shows such a network with 4 stages. 



Figure 3.11. Shortest path network associated 
with the inspection problem 

Each path in the network from node 0 to node 4 defines an inspection plan. 
For example, path 0-2-4 implies that we inspect the batches after stages 2 and 4. Let 
B(i) = B denote the expected number of nondefective units at the end of 

stage i. Then, the following cost Cjj could be associated with any arc (i, j) in the 
network : 

Ct|=fij+B(i)gi, + B(i)ii,, Pk (3.na) 

Also, let Xjj be a binary variable denoting whether or not we select arc (i, j) in the 
shortest path in the network defined in the above manner and let tjj be the time it 
takes to inspect a batch after stage |, given that last time batch was inspected after 
stage i. Then the fonnulation could be given as 
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[P] Min 2 CijXjj 
(i,j)eA 


subject to 



r 1 if i=0 



; = -1 if i=n 

(3.11b) 

{j:(i,j)€A} {j:(i,j)€A} 

1 0 otherwise 


X Xij ^ T 


(3.11c) 

(i,j)eA 



x^jS {0,1} 


(3.1 Id) 


where Cjj is as defined in (3.11a). 

The Lagrangian relaxation of [P] can be obtained by relaxing constraint (3.11c) 
with an associated multiplier X. Then, relaxed problem is as 

[Py) Min X Cij^j tijXij-T) 

(i,j)€A (i,j)€A 


subject to 

(3.11b) and (3.11d) 


As shown the relaxed problem is a shortest path problem with cost modified as ( Cjj 

+ Xtjj). 
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CHAPTER 4 

APPLICATIONS OF MAXIMUM FLOW PROBLEM 

In this chapter, we report the applications in which the relaxed Lagrangian 
problems are maximum flow (or, equivalently, minimum-cut) problem. We 
describe tiKe following applications in this chapter : 

1. Operations sequencing in discrete parts manufacturing 

(Bard and Feo [1989]) 

2. Capital budgeting with limits on annual budget 
(Mamer and Shogan [1987]) 

3. Capital budgeting scenario with threshold constraints 
(Mamer and Shogan [1987]) 

4. Repair kit selection problem with limits on annual inventory budget 
(Mamer and Shogan [1987]) 

5. Repair kit selection subject to a service level constraint 
(Mamer and Shogan [1987]) 

6. Selecting freight handling terminals 

7. Forest scheduling problem 

Application 4.1: Operations Sequencing in Discrete Parts Manufacturing 
Reference : Bard and Feo (1989) 

It is the problem of sequencing the cutting operation associated with the 
manufacture of discrete parts on a CNC machine. Two interrelated questions must 
be answered before prduction can begin in such scenario : (i) in what order should 
the metal be removed from the blank? (ii) which tools should be used in cutting 
operations? 

The problem is to minimize the production time, and the formulation is as 
follows : 

[P] F* = min F(x, y) = ZlLj Cj X| + fj y^ 
subject to 


Xj aijXj ^1 


for i = l...m 


(Ala) 



(41b) 


^ ^ IJt 1 Jt 

Xj,yt = (0,l) 

where 

fl if path j is chosen 
^■"^0 otherwise 

fl if tool t is chosen 
otherwise 

m = number of elemental voliimes 


(41c) 

(41d) 


n = number of paths 

r = number of tools 

fl if volume i is in path j 
"^0 otherwise 

N = tool maga 2 ine capacity 

= set of paths that require tool 'f 

Cj = total time it takes to cut path j 

fj = fixed setup and alignment time for tool t. 

Constraint (41a) ensures that each volume Vjwill be removed. Constraint 
(4.1b) ensures that tool t is in the tool magnazine if it is used for any of the selected 
paths. Constraint (4.1c) imposes the limit on number of tools used. The Lagrangian 
relaxation proposed by relaxing (4.1a) and (4.1c) and associating non-negative 
multipliers A, and |x respectively with each, is as : 

[PrI 80., n) = min E” , Cj xj + 5^, fj y, + E” , Xj (1- ajj Xj) + n (JJ y, - N) 

= min [E;:,, (Cj - £ i X, aij)xj + (f, +n)y, + E” , X, -nN ] 

subject to 
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Xj,yj = 0,l (4.10 

Xj could be interpreted as marginal benefit received from removing volume Vj, i = 
l,..,m and p as the marginal cost of one unit of magazine capacity. 


The authors show that the relaxed problem has its primary advantage in its 
equivalence with another problem which can easily be recast as a minimum cut 
problem on a bipartite network. The provisioning problem, as it is popularly 
known, considers a set s^ containing r items from which to choose, each costing c^ > 

0 dollars. In this case, the r items are tools with associated costs Cj = fj + p. It 

considers another set of n items from which to choose, each of which confers special 
benefits Bj > 0. In this case, these n items are paths and for each path, Bj = 2^ - 

Cjj. A better understanding of the representation of in the form of the desired 
bipartite network can be had by referring to Figure 4.1. 



As shown in the figure, there are nodes for paths and for tools. The former 
are connected to a supersource by arcs with capacity Bj and the latter are connected to 
supersink by arcs with capacity Cj. The arcs (with infinite flow capacity) between the 
two sets of nodes arise in the case when a tool is used by a particular path. For 
example, tool 2 is used by paths 2 and 5. A possible minimum cut could be as shown 
in Figure 4.1. 


Application 4.2 : Capital Budgeting with Limits on Annual Budget 
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Reference ; Mamer and Shogan (1987) 

The capital budgeting problem is considered with following characteristics : 

1. There are M potential project, each of which must be taken fully or not. 

2. The undertaking of project i requires the performance of a known subset of 
a set of N activities. Set Sj is referred to as project i's enabling set. The 
different enabling sets may not be mutually exclusive. 

3. Cj is the cost of performing activity j. 

4. bj is the revenue earned by undertaking project i. 

5. The performance of activity j consumes units of resource whose total 
consumption cannot exceed A imits. 

Let 

fl if activity j is performed 
^ [0 otherwise 

fl if project i is undertaken 
otherwise 

The capital budgeting problem is to select projects which maximize profit 
subject to the resource limitation. The formulation is as : 

Maximize bj yj - Cj Xj 

subject to 

I^^iajXj<A (4.2a) 

yj < Xj -V j e Sj and 1 < i < M (4.2b) 

The problem when reformulated in equivalent minimization form becomes 
Minimize Cj Xj + bj (1 - yj) 
subject to 

^ A 

v X V j € S and I ^ i ^ 

J ■ » 


m 


(4.2 c) 
(4.2d) 



The first term of the objective function represents the total fixed cosfe of the 
activities performed, and the second term represents the total opportunity costs for 
the projects not imdertaken. 

Without the resource constraint (4.2c), the problem simplifies to one referred 
to as Problem (NET). Problem (NET) was first considered by Rhys (1970) and solved 
elegantly by Balinski (1970), who showed its equivalence to maximum flow problem 
on the network as shown in Figure 4.2. Thus, the problem is of the form of 
maximum flow problem with the additional constraint on resource, which in this 
case is the annual budget available for carrying inventory. This additional 
constraint is relaxed in a Lagrangian fashion by associating non-negative multiplier 
X with it and bringing into the objective function. This relaxed problem is solved as 
a maximum flow problem. 

0 Ofoo 



Fig. 4.2. Flow network of problem (NET) 

As shown in the Figure 4.2, the arcs from enabling set nodes to activites nodes 
have a capacity of oo if the activity is in that enabling set and is zero otherwise. 

Application 4.3 : Capital Budgeting Scenario with Threshold Constraints 

Reference : Mamer and Shogan (1987) 

This is a slight variant of problem of capital budgeting with limits on annual 
budget. It is same as Application 4.2 with the resource constraint E ^ ^ 

replaced by the "threshold constraints" aj yj > A. In the capital budgeting 
scenario, this means A now represents the minimum permissible ' level of seivice 
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to be provided by the projects undertaken, and aj represents project i's contributit 
to the service level threshold. Once this additional constraint has been considere 
the rest of the problem can again be shown as being equivalent to the Problem [NE‘ 
and consequently to a maximum flow network. The "level of service" constrain 
are relaxed in a Lagrangian fashion and one can proceed in a similar manner as th. 
of Application 4.2. 

Application 4.4 : Repair Kit Selection Problem with Limits on Annual Inventor 
Budget 

Reference : Mamer and Shogan (1987) 

The repair kit selection model was originally proposed by Mamer and Smitl 
(1982). Their work involved the following scenario : 

A repair facility must decide which parts (and tools) to include in the standarc 
field repair kit. Each repairman will use the standard kit for a single service call anc 
will return to the repair facility to have the kit restocked before proceeding to the 
next service call. If the service call requires parts not included in the kit, the 
repairman will either return to the repair facility to pick up the required parts or 
bring the failed item to the facility for repair. Assuming N parts are available for 
inclusion, stocking the repair kit is equivalent to choosing a subset k of the set of N 
parts. Inclusion of part j in the repair kit results in an annual inventory cost of Cj. 

When using the kit on a service call, the repairman will encounter a breakdown of 
any one of M types. Breakdown i occurs with an annual frequency of fj times per 
year and, at each occurence, requires a subset Sj of the set of N parts. Thus, on-site 
repair of a breakdown of type i is possible if and only if Sj c k. If the repair kit lacks 
at least one part required to repair a breakdown of type i, then a penalty cost of Pj is 
incurred whenever the repairman encounters such a breakdown. The objective of 
the service facility is to stock the standard repair kit in such a way as to minimize 
the sum of total expected annual penalty costs and the total annual inventory costs. 
There is an additional constraint on annual inventory budget. 

Let 

f 1 if part j is included in the kit 
qO otherwise 

r 1 if kit contains every part required for 
y. an on-sit repair of breakdown type i 
0 otherwise 
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Then the formulation proposed is as : 

M 

Minimize fj (1 - y^) 
subject to 

2^HCjXj^C (4.4a) 

^ j e Sj and 1 S i < M (4.4b) 

The objective is to minimize aimual frequency of breakdown where C is the 
total annual inventory budget. The authors show the equivalence of this problem 
with that of Application 4.2 after constraint (4.4a) is relaxed in a Lagrangian fashion. 
Hence, in this case also, the relaxed problem can be solved as a maximum flow 
problem subject to a side constraint. 


Application 4.5 : Repair Kit Selection Subject to a Service Level Constraint 
Reference : Mamer and Shogan (1987) 


This is a slight variant of the repair kit selection model of Application 4.4 in 
the way the objective function and the additional constraint are proposed. Here, the 
objective is to minimize the total annual inventory costs, subject to a service level 
constraint which specifies that least F percent breakdowns should be fixable with the 
repair kit. Therefore, following the same notations as that of Application 4.4, the 
formulation could be represented as : 

Minimize CjXj 
subject to 


M.5a) 

yj ^ Xj -V j e Sj and 1 < i < M (4.5b) 

One can proceed in the similar fashion as that of Application 4.4 for this 
problem as well. 


Application 4.6 : Selecting Freight Handling Terminals 

A transport company is considering the installation of a number of freight 
freight handling terminals. It wants to choose from a set S of possible locations for 
the terminals. The finn has the potential to attract market share (which is a given 
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amount of demand) between some of the pairs of terminal to satisfy the demand 
between locations i and j, the company must locate terminals, at both of these 
locations. Let Cj be the cost of installing a terminal at location j and pjj be the profit 

obtained by satisfying the demand between location i and j. Consider, for example, 
die network shown in Figure 4.6a. 



Each node in this network represents a potential terminal, the number next 
to it represents the negative of the cost of installing that terminal. Each arc (i, j) 
represents a service that can be operated only if both the terminal i and j are 
operating; the number next to an arc represent the profit obtained by operating that 
service. Suppose, we decide to operate terminals 1, 2 and 3; then we can operate 
service only between the following pairs of terminals : {(1, 2), (1, 3) and (2, 3)}. 

Next, suppose P be the minimum amount of profit that the company is 
interested in making while being in the business, i.e., the profit earned by installing 
terminals at i and j stationed over all such (i, j) pairs should exceed P. This type of 
"threshhold constraint" destroys a special structure of the problem, which can very 
easily be transformed to an equivalent network. Hence, if we relax the threshhold 
constraint in a Lagrangian fashion, we can solve the relaxed network flow problem 
to generate effective lower bounds to the original problem. We now show an 
equivalent network formulation of the relaxed problem. Let us define a bipartite 
network G = (N| u N 2 , A) with a node in Nj for every service and a node in N 2 for 
every terminal. The service node representing the service between nodes i and j has 
two outgoing arcs entering the nodes, representing the terminals i and j, implying 
that whenever we decide to provide the service between i and j and accrue the profit 
Pij, we must install the terminal at these two nodes and incur the installation cost 
and Cj. Figure 4.6b shows the resulting maximum weight closed problem {for the 
network of Figure 4.6a}. 
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This network can easily be transformed to an equivalent maximum flow 
problem, if we add a source s and sink t to the network and add the arcs (s, i) for all i 
with weight Wj > 0, and arcs (j, t) for all j with weight Wj < 0. The capacity of the arcs 
(s, i) is Wj and and arcs (j, t) is -Wj and capacity of intermediate arcs is infinity. Hence, 
in this case the relaxed problem is a maximum flow problem. 

Application 4.7 : Forest Scheduling Problem 

Paper and wood product companies need to define cutting schedules that will 
maximize the total yield of their forests over some planning period. A particular 
company with control of p units wants to identify the best cutting schedule over a 
planning horizon of k years. Forest unit i has a total acerage of aj units. Studies that 
the company has undertaken predict that unit i will have Wjj tons of wood available 

in the jth year. Based on its prediction of economic conditions, the company 
believes that it should harvest at least Ij tons of wood in year j (from all the forest 

units). Due to the availability of equipments and personnel, the company can 
harvest at most Uj tons of wood in year j. The company incurs a cost c^j per unit 

acerage to harvest wood in forest unit i in year j. The company has a fixed budget C 
at the starting of the planning period for the harvesting purposes and the 
expenditure on harvesting in all the forest units for all years should not exceed this 
limit. In what follows, a simple network model is associated with the problem 
above. As shown in Figure 4.7, two sets of node are considered, one each for forest 
units (i) and respective years (j), in planning period. Source (s) and sink (t) is then 

added to the network and arcs are added from node s to nodes ! and from nodes j to 
t. 
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Years 



Fig. 4.7. Forest scheduling as Maximum Flow Problem. 


The arcs (s, i) have zero cost and capacity equal to and arcs (j, t) have zero 
cost and, lower and upper bounds on flow as Ij and Uj units, respectively. The arcs (i, 
j) have an associated cost Cjj and capacity equal to Wjj. Note that for each forest unit, 
there is an outgoing arc for all the years. 

Having defined the network in the above way, it is easy to see that 
maximizing the yield over all the years is equivalent to finding a maximum flow in 
the above network subject to the constraint that expenditure over all the years is less 
than C. If Xjj is the flow on the arc (i, j) of the above network, then this constraint 

could be written as 

^(i,j)€A ^ (4.7a) 

where A is the arc set of this graph. This side constraint makes the problem hard by 
destroying the network structure embedded in the constraint matrix. Dualizing this 
constraint in a Lagrangian fashion by associating non-negative Lagrangian 
multipliers with it results in the relaxed problem that is easily solvable by the 
efficient algorithms available for maximum flow problem. 
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CHAPTER 5 

APPLICATIONS OF MINIMUM COST FLOW PROBLEM 

In this chapter, we report applications in which the Lagrangian subproblems 
are minimum cost flow problem. We describe the following applications in this 
chapter : 

1. Multilocation facility modernisation problem 
(Mason, Girard and Gu [1990]) 

2. Manpower planning problem with attrition constraint 
(Price and Gravel [1984]) 

3. Manpower planning problem with budget constraint 
(Price and Gravel [1984]) 

4. Routing of container ships 
(Rana and Vickson [1991]) 

5. Network flow problems with variable upper bounds 
(Shetty [1990]) 

6. Multicommodity flow problem 
(Savioz 2 i [1986]) 

7. Set partitioning problem 
(Ali and Thiagarajan [1987]) 

8. The equal flow problem 

(Ali, Kennington and Shetty [1987]) 

9. Node-weighted Steiner tree problem 

(Segev [1987]) 
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Application 5.1 : Multilocation Facility Modernisation Problem 

Reference : Mason, Girard and Gu (1990) 

Telecommunications and other public utilities are frequently faced with the 
task of modernising their facilities as a result of technological advance and/or 
demand for new services. The owner of these facilities seeks a modernisation policy 
which optimizes an economic indicator (most common being NPV), while 
satisfying all budgetary and service restrictions. 

The problem in its most general setting finds a typical example in local area 
telecommunication network, where each new customer has to be connected to an 
office by a dedicated line. The provisioning is done at fixed intervals, hence the 
model will have discrete time nature. 

New customers can be connected to 3 types of services : P, E or R. 

P , i.e.. Plain is simplest and uses either analog (A) or digital (D) transmissions. 

E , i.e., enhanced is telephone line upgraded for digital rates longer than what 

would be possible with a plain line. 

R , i.e., replaced gives even longer rates and more sophisticated services. 

At any instance, a line is characterized by its line type (or kind of 
transmission) and the service it uses, i.e., by {A, D} x {P, E, R}. Any such pair would 
be state of the line. Given a known demand at any given time the question faced by 
the planner is : How to meet the demand? This decision has to be taken for each 
office in the network, here called a location, and is independent except for the 
presence of global limits on the capital available for the modernization. These 
budget constraints are the complicating elements of the multilocation problem. The 
model description is as follows : 

INPUT PARAMETERS 

N number of states per location, in this case, these belong to the set {PA, PD, EA, 
ED,RD} 

L the number of locations 

T number of time periods 



45 


(t) total new demand in period t at location 1 

bj (t) net cash flow per line introduced at location 1 in period t into state i 

d? (t) net cash flow per line operating in state i between period t and t+1 at location 
1 

Cjj (t) net cash flow per line for the transition from i to j at beginning of period t in 
location 1 

DECISION VARIABLES 

aj (t) number of new lines introduced in state i at the beginning of period 't' at 
location 1 

(t) number of lines undergoing the transition from state i to state j at the 
beginning of period t at location 1 

y} (t) number of lines that remain in state i between period t and t+1 at location 1. 
yi* (0) = 0, by convention. 

COST FUNCTION 

In the objective (or cost) function, NPV is tried to be maximized 

Z* = max^ Z = [ X ^ ij ft) i ft) (y! ft) d? ft) + (t) bJ (t))] 

(i,j)er 

... (5.1a) 

CONSTRAINTS 

If D(t) is total budget available at the beginning of period t, budget constraint is 
as : 

+ fort = l..T (5.1b) 

(i,peT 

These are lower and upper bounds on number of lines that can undergo transition 
between two periods, namely Wj^ (t) and v|j (t); and also on number of lines that 
remain in the same state; namely p) (t) and (t). Therefore, 

V?; (t) ^ X?; (t) ^wi(t) 


t=l..T, V (i,i),l=l..L 


(5.1c) 
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Pikt) < yj(t) < c^kt) t = 1..T, i = 1..N, 1 = 1..L (5.1d) 

Finally, no new demand should go without service 

akt) = a? (t) ( 51 e) 

Similarly, lines that are going to be upgraded should not disappear and hence the 
conservation equation : 

S x|j(t) + y/(t)-yj(t-l)-aj(t) = 0 t = 1..T, 1 = 1..L, i = 1..N (5.1f) 

apsT 

Finally, we have the following usual conditions. 

xj (t)>0 integer ( 5 . 1 g) 

yj (t) > 0 integer (5.1h) 

On the time-expanded network, the model is multicommodity flow made up of T 


transition networks. The complicating constraints here is the budget constraint 
(5.1b), which is given a price (Lagrangian multiplier u^ associated with t^^ constraint 

(5.1b)) and is incorporated into objective function. 

The Lagrangian function L(u) can be written as : 

L(u) = max^ [Z + E^^jUj (E^^j E jj xj (t) cj (t) + Zj aj (t) bj (t) +D(t)] 
subject to 

constraints (5.1e) - (5.1h) 

The task is to obtain smallest upper bound, that is, to solve the problem 

rnin^j L(u) subject to u > 0 (5.1i) 

The authors show that the interest of the method lies in the fact that this 
problem separates into L independent single-location problem (Again, the term 
'Location' here refers to an office site), since the budget constraints have now been 
uncorporated into objective function with suitable multipliers. Because of the form 
of constraints (5.1c)-(5.1d) each of these subproblems is an ordinary minimum cost 
flow problem that can be solved by any minimum cost flow algorithm. A more 
detailed description of the above can be found by referring to the original paper by 
Mason, Girard and Gu (1990). 
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Application 5.2 ; Manpower Planning Problems with Attrition Constraint 
Reference : Price and Gravel (1984) 

A certain class of manpower problem is often modelled using goal- 
programming. The authors refer to the paper by Price (1978), which discribes this 
problem in the following way : 

Consider a hierarchy (see Figure 5.2a) divided vertically by rank and 
horizontally by occupational classification or trade. 



Fig. 5.2a. Three ranks, two classification system. 

Hiring is possible only into the lowest rank, and promotions are only to next 
higher rank. Demotions are neglected, and attritions can be forecast. It is desired to 
find a hiring and promotions plan for the next time period that honours constraints 
on : 

1. numbers in each rank/ classification cell 

2. numbers promoted from one level to another 

3. total number in a given rank 

4. total number promoted from one rank to another. 

Let us consider how this problem can be represented as a network flow 
problem. 
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x^ (t) strength of rank i, classification j, at the end of period t 

yjj (t) the number promoted out of rank i (to rank i+1), classification j during period t 
<{)jj (t) lower bound on Xjj (t) 
ajj (t) upper bound on (t) 

Xjj (t) lower bound on y- (t) 

Pjj (t) upper bound on yjj (t) 

ajj (t) attrition from rank i, dasification j, during period t. 

Now, the following constraints are expressed. 

Manning level in each rank/classification state < x^j (t) < ttjj 
Promotion level from each rank/ classification state t..- < y.-- (t) < B-- 

Ij J 1] r'l] 

Manpower accounting constraints Xj^ft-l) - (t) - (t) + (t) = x^j (t) 

Now, a representative network of the above could be shown as in Figure 5.2b. 

TimeTQ TimeTj 
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Fig. 5.2b Network Representation. Two dassification, 
three ranks, one time transition. 
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The triplets of arcs are used to represent the goal formulation. Figure 5.2c 
illustrates how this is done. The upper arc carries all flow that is between desired 
flow limits and bears no cost. The second arc, at the cost C 2 bears any overflow that 
must be carried to meet overall goals. The third arc, at cost C 3 and in opposite 

direction to the first two, will bear any flow needed to compensate for the lower 
bound on the first arc. 
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Fig. 5.2c. Representing the goal formulation 

Refering back to Figure 5.2b, note that a supersource and a supersink (shown 
as network source and sink) are added to complete the network and arcs have been 
added from various nodes that have capacities as existing state at time Tq at that 

node. The arc connecting to source of new hires has infinite capacity. 

The attrition constraint. For the network extending over several time-periods, one 
would like to address to the problem of attrition, i.e., losses due to retirements and 
voluntary departures. To accomodate this, the attrition flow out of a node is fixed at 
some percentage (p) of the total flow representing retired manpower. This would 
introduce ratio constraints of the form 

aij(t) =pxij(t) 

where p is the attrition rate. 

The addition of such a constraint destroys the network structure of the 
problem and we will address to this problem by Lagrangian relaxation. 





In general, the complete problem including both network structure and side 
constraint can be expressed as : 

(P) Minimize cx 

subject to 

Ax ^b 

Sx<d 

x>0 

Let constraint (5.2a) define the network structure of the problem and matrix S 
contain the side constraint. Then, the relaxed problem is 

(PR;^) Minimize (cx + X,(d-Sx)) 

subject to 

Ax < b (5.2d) 

X > 0, X > 0 (5.2e) 

which can be solved as a minimum cost flow problem with cost vectors being (c-S). 
Now, the subgradient approach can be used in the usual manner to obtain tight 
lower bounds on the attrition problem. 

Application 5.3 : Manpower Planning Problems With Budget Constraint 
Reference : Price and Gravel (1984) 

An aspect not covered by the manpower problem with attrition constraint is a 
means of maintaining direct financial control. One might wish to ensure that in a 
given time period, some overall budgetary restrictions were honoured. This could 
be done by adding the constraint | 

X xj: (t) . Sy (t) ^S(t) (5.3a) I 

(MgH) 

where S(t) is the budget available in period t, Sjj (t) is the salary paid in the category ij 
in period t, and H is the set of arcs representing manpower levels in period t. | 

Bundle constraint of this kind when added to the manpower planning problem | 

destroy its network shiicture. In addition to the constraints on salary budgets, other I 


(5.2a) 

(5.2b) 

(5.2c) 



bundle constraints may also exist. One might wish, for example, to control the total 
numbers hired, or in some other way restrict the weighted sum of flows in the arcs. 
Any such constraints may be grouped and treated by the Lagrangian relaxation 
techniques as presented in the Application 5.2. 

Application 5.4 : Routing of Container Ships 

Reference : Rana and Vickson (1991) 

Seaborne shipping is considered to be the major artery of international trade. 
In international shipping, a large number of consignments coming from many 
different sources make a shipload of general cargo. Containers loaded at one port, in 
general, have more than one port of destination, and may not fill a ship. Since this 
model considers both pickup and delivery at a port, it differs from the travelling 
salesman or vehicle routing problem. The problem of scheduling container ships, 
then, is to find the optimal route for each ship and the cargo it carries between any 
port pair and to calculate the frequency of service provided for each port. Even 
without including such stochastic elements as weather conditions, delays or waiting 
times, the problem is quite large and complex. 

A ship travels in one direction, loading and discharging cargo at the 
intermediate and end ports. It may visit ports on its Eastbound voyage or the 
Westbound voyage, which depends on the amount of cargo available at respective 
ports. Availability of cargo is determined at weekly basis and accordingly a schedule 
is determined and the shippers are informed. The typical network associated with 
container trade is as shown in the Figure 5.4, and it is obvious that it is different 
from type of networks used in vehicle routing. 

Out bound direction 

Pom @ @ 0 - 

In bound direction 

Fig. 5.4. Network of ports 

We give the description of the mathematical formulation without giving the 
exact model, because of the length and the complexity of the model (Interested 
reader may refer to original paper for more detailed view on the same). 

The objective is to maximize the net profit, i.e., revenue minus operating 
costs, from multiple shifts alloted to a network of ports. The constraints are as 
follows : 
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1. Capacity constraints - Ship's capacity cannot be exceeded on any voyage 
segment 

2. Departure and Arrival constraints - If the ship is not visiting either the port 

of origin of some cargo or the port of the cargo's destination, the cargo cannot 
be transported. 

3. Cargo constraints - Total cargo transported from port i to port j cannot exceed 
the available cargo. 

4. Network constraints - These constraints serve two main requirements. First, 
a ship must make a connected trip and second, it must have an option to stop 
at a port or not. 

5. Route time constraints - The total time spent by a ship in making an integer 
number of trips should not exceed the planning horizon. 

The authors show that by relaxing the complicating constraints on capacity, 
i.e., constraint number (1), in a Lagrangian fashion, the problem decomposes into v 
subproblems, here v is the total number of ships to be assigned to the network. Each 
subproblem, called SPj^ for k = l,..,v is treated further by decomposing the 

underlying network in such a way that a fixed source and destination pair is 
considered at a time. This subproblem is treated further by“ a specialized algorithm 
which decomposes it into two subproblems, namely, CAS (Cargo Allocation 
Subprograms) and INS (Integer Network Subprograms), where the latter can be 
solved by any minimum cost network flow algorithm. 

Application 5.5 : Network Flow Problems with Variable Upper Boimds 

Reference : Shetty (1990) 

The network problem with variable upper bounds (abbreviated as NVUB) is 
easily conceptualized as a minimum cost network flow problem with variable upper 
bounds on certain arcs. The problem is represented by an nxm node-arc incidence 
matrix. A, in which k arcs are identified and required to have variable upper 
bounds. The columns of A are so arranged that the first k columns (A|) corresponds 
to VUB arcs and the remaining m-k columns (A 2 ) to others. Mathematically, 

NVUB is represented as : 

Min cx + da + ez 
subject to 



AjX + AjO = b 
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(5.5a) 


0 ^ u 


(5.5b) 


O^a^v 


(5.5c) 


X, CT, z, integer 


(5.5d) 


Here, [c, d] is a Ixm vector of unit costs, b is nxl vector of node requirements, 0 is an 
approximately dimensioned vector of zeroes, [u, v] is an mxl vector of upper 
bounds, and [x, ct, z] is the vector of decision variables. Constraints (5.5b), also 
known as the side constraints, represent variable upper bounds in which each arc in 
X is bounded by a decision variable in z. NVUB belongs to the class of NP-complete 
problems, therefore, effective heuristics based on Lagrangian relaxation and 
decomposition, have been proposed in the following manner. 


A lower bound on the objective function of NVUB can be obtained by using 
the Lagrangian dual of the the problem exploiting the embedded network structure 
of the problem. Associating the Lagrangian multiplier coj^ with the kth side 
constraint and defining the k-vector co = (caj-.w^.), the Lagrangian dual for NVUB, 
referred to as LNVUB, may be stated as 


[LNVUB] Max H(co) 
cosO 


where H((d) = min{cx + da + ez + (o(x-z)} (5.5d) 

subject to 


constraints (5.5a), (5.5c) and (5.5d) 

This problem separates into subproblem of variables of z and x, respectively. 
The optimal value of subproblem in z can be found by inspection. However, the 
optimal values of subproblem in x require solution of a minimum cost network 
flow problem given by : 

min {(c+co)x + da I A|X + A 2 C = b, 0 ^ x ^ u, 0 ^ a ^ v}. 

Thus, LNVUB provides effective lower bound to NVUB. 

Application 5.6 Multicommodity Flow Problem 
Reference : Saviozzi (1986) 



The author proposes the idea of using Lagrangian relaxation to provide 
advance start for the multicommodity network flow problem. Multicommodity 
network flow problem arises in a variety of applications, some of which are routing 
of multiple commodities on a network, multilevel tanker scheduling, warehousing 
of seasonal products, etc. For a given node-arc incidence matrix A representing a 
directed graph, the minimization problem P to be solved for multicommodity flow 
problem can be stated mathematically as 


[P] nain ^ c*' x^ 

k 



subject to 



Ax*' = r*' 

^ k=l.. K 

(5.6a) 

VI 

X 


(5.6b) 

0 < x*' < u*' 

= 1 ,.., K 

(5.6c) 

where x*', c*', u*', r*' are. 

respectively, the flow, cost, requirement and capacity vectors 


for commodity k; and b is the arc capacity vector to be shared among the k 
commodities. 

The problem P can be represented for k commodities as a minimum cost 
network flow problem for each commodity with (5.6a) and (5.6c) as constraints, but 
for the constraint (5.6b) that is, binding on all the commodities to share mutual arc 
capacity. The Lagrangian relaxation scheme is, therefore, used effectively in this 
case, where the independent subproblems are minimum cost network flow 
problems. 

The following maximum problem is proposed : 
max^ > 0 {L(co)} 

= maXjij ^ g miUjj { ^ c*"^ x^ + co(]^ x^ - b) | Ax^ = r^, 0 ^ x'^ ^ u*^} 

k k 

= maXju > Q {-cob + ^ min^^ (c*^ + co) I Ax*^ = r*^ , 0 ^ x^ ^ u*'} 
k 



This is obtained by dualizing capacity constraints (5.6b) in a Lagrangian fashion and 
associating with it a multiplier vector co. The updated costs are (c^ + co). The 
resulting subproblem is, thus, minimum cost network flow problem. 


Applicaton 5.7 : Set Partitioning Problem 

Reference : Ali and Thiagarajan (1987) 

Set partitioning problems are perhaps the most widely encountered of the 
class of binary integer programs. The set partitioning problem is stated as jmin 
cx I Ex = e, X binary}, where E is an mxn binary element-set incidence matrix with ejj = 

1 if element i belongs to set j and 0 otherwise, and e is an m-vector of I’s. The 
solution of these problems is based on the fact that the hidden network structure in 
the set partitioning constraint matrix, E, can easily be exploited. If the constraint 
matrix E does not have any apparent structure, the question of existence of hidden 
special structure arises. However, E can be exploited to have completely hidden 
structure in very specific application only. The set partitioning problem (SPP) as 
explained above can also be written as 

[SPP] min cx 

subject to 


Ejx = ej 

(5.7a) 

E 2 X = e2 

(5.7b) 

X binary 

(5.7c) 


where m^xn submatrix Ej is a row submatrix transformable to a network. The m 2 xn 
submatrix E 2 forms the remaining constraints. It can, therefore, be shown that SPP 
is equivalent to a problem [NS], given as : 

[NS] min cx 

subject to 


Sx = e 


(5.7e) 



X binary 
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(5.7f) 

where A is node-arc incidence and S is the set of side constraints. 

The solution strategy using Lagrangian relaxation is as follows. The 
Lagrangian function, is obtained by dualizing non-network side constraints SX = 
e, where X is the vector of associated dual variables and given by 

L;;^^ = min {cx + A,(Sx - e) I Ax = b ; x binary} 

For a given value of X,, ^ is a minimum cost network flow problem with cost 
updated as (c+X.S). 

Application 5.8 : The Equal Flow Problem 

Reference : Ali, Kennington, and Shetty (1987) 

The equal flow problem is easily conceptualized as a minimum cost network 
flow problem with additional constraints on certain pairs of arcs. Specifically, given 
pairs of arcs are required to take on the same value. The problem is defined on a 
network presented by an mxn node-arc incidence matrix. A, in which k pairs of arcs 
are identified and required to have equal flow. 

Mathematically, this is expressed as : 

[P] min cx 

subject to 


Xi 

11 


(5.8a) 

- ^k+K ' 

A' k =1 .. K, 

(5.8b) 

0 < X < u 


(5.8c) 

X integer 


(5.8d) 


where c is a Ixn vector of unit costs, b is an mxl vector of node requirements, 0 is an 
nxl vector of zeroes, x is an nxl vector of decision variables, and u is an nxl vector 
of upper bounds. It is also assumed, without loss of generality, that Uj. = for k 

= 1,.., K. By the very nature of the constraints (5.8b), these are treated as side 
constraints. 



ApplicaUons of equal flow problem are diverse raavin, r 
to estimating driver cost in transit operation to two duty penod'H Tr 
md so on. llte Lagrangian dual of the equal flow prob.L is o“® 

the equal flow constmmts (5.8b) by associating multiplier vector m with it T! 
Lagrangian function hfco) obtained is as : 


h(a)) 


min {cx + co,^ (x^ . | Ax = b; 0 ^ 

k 


x^u} 


It is obvious that solution to h(o,) for generating effective lower bounds is obtained 
by solving a mimmum cost network flow problem. 

Application 5.9 : Node-Weighted Steiner Tree Problem 

Reference : Segev (1987) 

This is a natural extension to the Steiner tree problem in which costs 
associated with node are allowed. It frequenUy happens in practical solutions that 
the node weights represent benefits while the edge weight represent costs, fhus, the 
nodes might represent profit centres and the edges represent the cost required to 
achieve the profits. This model can be applied to decisions regarding offering of 
services such as eiectronic mail and cable TV, where the node weights would 

represent the revenues obtained from the subscribers. The flow-based formulation 
of the problem is as follows : 


Let f 


ikt flow of commodity i on arc (k, t) 

Y. node i is in the optimal tree 

i “[0 otherwise 

Y.. j) is in the optimal tree 

ij ~l0 otherwise 


The model is as : 


P] Min I q Xi + 2 X Cij Y,, 


1€T 


ieT jeN 


subject to 


2 ^ikt ■ 2 ^itk “ 
teT teN 


ie T, ke N, k^tn, K;*! 


(5.9a) 



S ^ikt ” S ^itk ^ 

teT teN 


I fikt - S fitk = -Xi 

teT teN 

^ikt ^ ^kt 
Yij,Xie{0,l} 

(5.9e) 

N : set of nodes 
T 

Cj : cost associated with a node {Cj < 0} 

Cjj : cost associated with an arc 

In the lower bounding procedure, the above problem is augmented by adding 
several other constraints, and the coupling variables Xj's are taken care of by tiieir 

"transfer" to an added dummy node. This changes the constraints (5.9b) and (5.9c) 
into that of a standard network form. The resulting problem thus has several 
additional constraints, a few of which are relaxed in a Lagrangian fashion. The 
resulting problem separates into two subproblems, one of which is a 
multicommodity network flow problem with no interconnection betwen the 
commodities. Therefore, the problem is separable into |T| single-commodity flow 

problems, each of which can be solved as a standard minimum cost flow problem. 


i6T,k = l 
i€T,k = n 
ieT,k€T, teT 


ao 


(5.9b) 

(5.9c) 

(5.9d) 
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CHAPTER 6 

APPLICATIONS OF ASSIGNMENT PROBLEM 

In this chapter, such applications have been reported in which the relaxed 
Lagrangian subproblem is an assignment problem. We describe the following 
applications in the chapter. 

1. Lagrangian approach to the traveling salesman problem 
(Balas and Christofides [1981]) 

2. Maximum collection problem 
(Kataoka and Morito [1988]) 

3. Multi-depot vehicle scheduling problem 
(Cararessi and Gallo [1984]) 

4. Prize collecting traveling salesman problem 
(Balas [1989]) 

5. Scheduling daily operations in a steel rolling problem 
(Balas [1989]) 

6. Personnel assignment in the armed forces 

Application 6.1 : Lagrangian Approach to Traveling Salesman Problem 

Reference : Balas and Christofides (1981) 

The traveling salesman problem (TSP), i.e., the problem of finding a 
minimum-cost tour (or hamiltonian circuit) in a directed graph G = (N, A), can be 
formulated as follows : 
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[P] inin Z ZCijXj: 

ieN jeN 



subject to 



Z ^ij = 1 

jeN 

A^ieN 

(6.1a) 

Z ^ij = 1 

ieN 

jeN 

(6.1b) 

XjjS {0, 1} 

A^ i, je N 

(6.1c) 

X is a tour 


(6.1d) 


For (i, j)e A, Cjj is the cost associated with the arc (i, j). 

Condition (6.1d) can be replaced by the typical subtour elimination constraint 
as : 

Z Z Xij^lS|-l ScN,l<|Sl<n (6.1e) 

ieS jeS 

If we write constraint (6.1e) in its generic form, it becomes ; 

Z Z a‘o ^teT (6.10 

ieN jeN 

where S and T are node sets such that 
(S,T) = {(i,j)€A I ieS,jeT} 

TSP is classical optimization problem with wide applicability to the modeling of 
such important application situations as scheduling, sequencing, routing, etc. 

The Lagrangian problem is obtained by relaxing (6.10 and associating 
multipliers w : 

maXvy^O 


subject to 



(6.1a) - (6.1c) 

where L(w) = min^gX 2 S (Cjj " X Wj + X 

i i teT teT 

This clearly calls for solving assignment subproblem embedded in constraints 
(6.1a) - (6.1c) and generates tight lower bounds for the original problem. 

Application 6.2 : Maximum Collection Problem 

Reference : Kataoka and Morito (1988) 


Travelling Salesman Problem (TSP), Vehicle Routing Problem (VRP) and 
some other studies consider an optimal tour of a graph, assuming that "all" of the 
nodes of a given graph should be visited exactly once or at least once. This 
assumption is relaxed in the maximum collection problem, which is stated as : 

"Given items with known values located at nodes of network, one wants to 
collect items so that their total value is maximized under the assumption that a tour 
starting from the central node and returning to it is completed within 
predetermined time limits." 

Consider an asymmetric graph G (V, E), where V and E are node and arc sets, 
respectively. Cj 5: 0 and t^ > 0 denote value allocated to node ie V and time required 
to travel arc (i, j)e E, respectively. Xjj and yj are both 0-1 variables associated with arc 
(i, j) and node i, respectively. Let V be the set of nodes selected to visit and let S and 
S be the partition of V such that suS = V, SoS = (]), S 9^ (J) and S V . Then, a naive 
formulation could be presented as : 

(FORMULATION 1) 


Max Cj yj 


subject to 




(6.2a) 


V i 




(6.2b) 
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(6.2c) 

^ i€ s ^ j€-s ^ ^ partition of (S, S ) (6.2d) 

XjjC {0, 1), Yi e {0, 1}, Yi = 1 {central node) (6.2e) 

where (6.2a) is the constraint on total time (TC) and (6.2d) is the constraint for 
subtour elimination. A relaxed problem without these two constraints (with 
appropriate Lagrangian multipliers) is the assignment problem and thus can be 
solved easily. However, variables must be determined prior to doing this. The 
Lagrange multipliers appear only as coefficients of Xjj and thus coefficients of y^ are 
not affected. To alleviate this difficulty, an alternative formulation (2) is 
contemplated with following transformations : 

(Transformation 1) Let (c^ > 0) be the cost coefficient of each arc in E where Cjj = Cj, 
i€V-{j}. 

(Transformation 2) Create a self-loop for each node i with x^j€ (0, 1} where Cj| = 0, tjj 
= 0, ie V- {!}. For the centre node c^j = 0, tj^ = Tc. 

Now, the alternative formulation could be presented as : 


(FORMULATION 2) 

Max Cjj Xjj 

subject to 




(6.2f) 


Y i 

(6.2g) 


^ j 

(6.2h) 

^ ieS^ je'S^ij ^ ^ 

for any partition (S, S) of 

(6.2i) 

Xjje (0, 1} 


(6.2j) 



Now, the appropriate Lagrangian multipliers could be associated with 
constraints (6-2f) and (6.2i), respectively and the remaining problem can be solved as 
a standard assignment problem to generate tight upper bounds. 

Application 6.3 : Multi-depot Vehicle Scheduling Problem 

Reference : Cararessii and Gallo (1984) 

Vehicle scheduling refers to large class of optimization problems in which 
vehicles must be assigned to time-tabled trips in such a way that 

a) each trip is carried out by one vehicle 

b) a given set of constraints is satisfied 

c) a properly defined cost function is minimised. 

Let us assume that a time-table is given, that is a set V = {vj .. Vj^} of trips is 
given where each trip Vj is defined by a quadrupole (Tj, Ij, Oj, dj), where: 

T| the departure time; 

Ij the length of time or duration; 

Oj the origin or departure terminal; 

dj the destination or arrival terminal; 

The deadheading trips are also allowed, that is, the ones from dj to Oj and 
their duration is denoted by Sjj. 

The ordered pair (Vj, Vj) is said to be a compatible pair of trips if 

X* “(“1* "f* 5*' “f" £ “ X* (6.3a) 

where e > 0 is prefixed tolerance parameter, introduced to take possible delays into 
account. Equality (6.3a) states that it is feasible to have trips Vj and V| operated in 

sequence by the same vehicle. The authors propose the basic network models and 
show that with each vehicle scheduling problem we can associate a simple and 
extremely useful graph. Let G = {S, T, A) be a bipartite graph where S = {Sj .. S^} and 
T = {tj .. t^} are the sets of nodes and A = ((Sj, tj ) : (Vj, Vj) is a compatible pair of trips} 
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is the set of arcs. A matching on G is a subset of arcs A c A such that each node is 
incident to at most only arc of A . It is shown that from the bipartite graph (S, T, A), 
a simple network model can easily be derived, the feasible flow on which defines an 
assignment between S and T. The most frequent case with vehicle scheduling 
problems is that of single depot problem, i.e., all vehicles are housed at the same 
depot. However, with large companies, the problem takes the form of multi-depot, 
each with a given capacity of housing maximum number of vehicle. The flow 
model is of multi-commodity type and is much more complex than single-depot 
problem. 

A complex mathematical model is presented in which Lagrangian relaxation 
coupled with subgradient optimization can be used to generate effective lower 
bounds. 


pp] Min ^(ij)€AuA 

•'ii ’‘ij 


subject to 


i = 1 .. n, k = 1 .. 1 

(6.3a) 

^ielO) yjk 

j = 1 .. n, k = 1 .. 1 

(6.3b) 


Y k = 1 .. 1 

(6.3c) 


Wi = l..n 

(6.3d) 

o 

AI 

X 

J/(i,j)6AuA*, k = l..l 

(6.3e) 

YikefO, 1) 

a/ i = 1 .. n, k = 1 .. 1 

(6.3f) 


Here 

1 number of depots 

ajj capacity of depot k 

A set of all compatible trips 

A* = {(Si, tj) : (Si, tj)« A and either ^ tj + Iq + 5ij or i = jl 



q. = {the cost of deadheading traveling and idle time between the end of trip v- 
and the beginning of trips Vy if (Sj, A; 

the cost of deadheading from the depot to the departure terminal of v- plus 
the cost of deadheading trip from the arrival terminal of v to the depot if (S-, 
tj)eAM 

-for (i, j)e A 

k _ P ^ vehicle housed at depot k runs trips Vj and Vj in sequence 
“to otherwise 


-for (i, pG A* 


xM 



if trips Vj and Vj are the first and the last trips 
respectively of vehicle duties assigned to depot k 
otherwise 


-for i = 1 .. n 


Yik 


1 if trip Vj is assigned to a vehicle housed at depot k 
.0 otherwise 


The flow model is of the multicommodity type for the various depots k = 1 
1. It is proposed that there is no need to impose the integrality constraint on x^ ; 
since the yjj^ are fixed (at binary values), the problem decomposes into 1 smaller 
assignment problems, and this is where the possibility of using Lagrangian 
relaxation arises. Although not shown formally through the mathematical model, 
it is proposed that if we relax constraint number (6.3d), the one binding for all 
depots, and bring it into the objective function with suitable multipliers, the relaxed 
problem is separable into 1 smaller generalized assignment problems. 

Application 6.4 : Prize Collecting Travelling Salesman Problem 

Reference : Balas (1989) 

This problem is a slight variant of maximum collection problem discussed in 
Application 6.2. The statement of the problem is as follows. 

A travelling salesman who gets a prize Wj^ in every dty k that he visits and 
pays a penalty for every city he fails to visit, and who travels between cities i and j at 
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the cost Cjj, wants to minimize the sum of his travel cost and net penalties, while 
including in his tour enough cities to collect a prescribed amount Wq of 'prize 

money'. 

Let Yi be 1 if city i is included in the tour and 0 otherwise, and let x be the 
incidence vector of the tour, then the problem can be formulated on a complete 
directed graph G' = (N, A) as 

min ^ieN ^jeN-{i} ^ieN Pi *yi) 


subject to 


^j€N-{i) ^ij - Yi 

i = 1 .. n 

(6.4a) 

li 

X 

A j = 1 .. n 

(6.4b) 



(6.4c) 

YiG {0, 1} 

ie N, Xjj6 {0, 1}, (i, jje A 

(6.4d) 

G' (y, x) is a cycle. 


(6.4e) 


where G' (y, x) is the subgraph of G’ whose nodes and arcs are those defined by y and 
X, respectively. 

It is convenient for the sake of formulation to complement the variables yj, 
ie N, i.e., introduce n new variables Xjj = 1 - yj, ie N, to represent the self-loops of 
graph G = (N, AuO) obtained from G'by endowing every node with a loop (O is the 
set of loops). Now, if we define Cjj = Pj, ie N and U = 2 Wj - Wg, then the problem 

can be restated as : 


min cjj Xjj 

subject to 


Ij"! Xjj = 1 Y j = 1 .. n 



Wj Xjj U 


(6.4f) 

(6.4g) 


(6.4h) 



Xij€{0, 1}, i, j = l.. n 

G(x) has exactly one cycle of length ^ 2 
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(6.4i) 
(6.4j) 

In this problem, if we relax constraints (6.4h) and (6.4j) in a Lagrangian 
fashion, the resulting problem is an assignment problem that can generate effective 
lower bounds to the original problem. 

Application 6.5 ; Prize Collecting Travelling Salesman Problem : An application to 
scheduling daily operations in a steel rolling mill 

Reference : Balas (1989) 

The prize collecting travelling salesman problem can be formulated to model 
the scheduling the daily operations of a steel rolling mill. The problem is defined as 
follows : 

A rolling mill produces steel sheet from slabs by hot or cold rolling. For 
reasons that have to do with the wear and tear of the rolls as well as other factors, 
the sequence in which various orders are processed emerges as a critical factor. 
Scheduling a round consists of choosing from an inventory of slabs assigned to 
orders, a collection that satisfies the lower bound on total weight, and ordering it 
into an appropriate sequence, e.g., one that minimizes some function of sequences. 
Since the choice of slabs for the round limits the options available for their 
sequencing, the two tasks must be solved jointly. If a slab for an order is selected and 
is processed, it gives some benefit and the order which is not processed or is delayed 
induces some penalty. A particular sequence of order, i.e., one after another, also 
induces some cost and there could be a constraint that a minimum benefit (or profit) 
has to be made. From the above description of the problem, it is obvious that Prize 
Collecting Travelling Salesman Problem as a model captures the essential features 
of this problem and therefore, the techniques described in the Application 6.4 can be 
effectively used for this problem as well. 

Application 6.6 : Personnel Assignment in Armed Forces 

In the armed forces, many men and women are qualified to perform specific 
jobs, or postings. The armed forces would like to assign the service personnel to 
postings in such a way that moving costs do not cross a certain limit. The 
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assignment done correctly in this way result in a "value" for each of such 
assignment and the objective for armed forces would be to maximize the total value 
of such assignments. Let djj be the expected value of an assignment (i, j) and let aj^ 

be the associated posting costs. General rules specify the needed qualifications of the 
personnel for the postings and identify the jobs that need to be filled. Policy rules 
determine the allowable assignments that reflect job qualifications and personnel 
requirements. For an allowable assignment, the posting cost ajj is the dollar cost of 

moving the person, his or her family, and his or her belongings to the new 
residence. Let d denote the budget amount available in a period for total posting 
costs. Then the problem [P] of personnel assignment could be formulated as follows. 


m 'i»n 

min clij 



subject to 



Z", Xi: = l 

^ i = 1 .. n 

(6.6a) 

1) 



^ "l Xij = 1 

j = 1 .. n 

(6.6b) 

'T-i n. w-1 n ^ jk 

^i-l ^j.l “ij Xij ^ 


(6.6c) 

XjjC {0, 1), 

W (i, j) = 1 .. n 

(6.6d) 


Here G (N, A) is a graph, with set N of n nodes and set A of m arcs, associated 
with the assignment problem and Xjj is the binary variable denoting whether or not 

person i is assigned to job j. Constraint (6.6c) ensures that the posting costs remain 

below a particular amound 'd'. 

The problem is easily solved as an assignment problem, if the constraint (6.6c) 
is relaxed by associating a Lagrangian multiplier p ^ 0 with it. The relaxed problem 

is, as follows : 

max (djj + paij)Xij - pd 

subject to constraints (6.6a), (6.6b) and (6.6d). 
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CHAPTER 7 

ADDITIONAL APPLICATIONS 

In this chapter, we report applications whose Lagrangian relaxation result in 
more than one Lagrangian subproblems, one or more of which may be standard 
network flow problems. In addition to these, we also report such applications that 
have not been covered under the previous four chapters. These applications are as 
follows : 

1. Designing optimal railroad operating plans 
(Keaton [1989]) 

2. Delivery problem 
(Altinkemer and Gavish [1991]) 

3. Capacitated fixed-charge minimum cost network flow problem 
(Khang and Fujiwara [1991]) 

4. Steiner problem in graphs 
(Beasley [1984]) 

5. Star-star concentrator location problem (SSCLP) 

(Mirzaian [1985]) 

6. Routing in point-to point delivery systems 
(Leung, Magnanti and Singhal [1990]) 

7. Flow problem with fixed charge : Routing electronic data 
(Hochbaum and Segev [1989]) 

8. Application of Lagrangian decomposition to resource constrained minimum 
weight arborescence problem 
(Guignard and Rosenwein [1990]) 

9. Designing minimal spanning tree subject to a budget constraint 
(Jornsten and Migdalas [1988]) 

10. Routing for circuit data networks 
(Yee and Lin [1992]). 



Application 7.1 : Designing Optimal Railroad Operating Plans 
Reference : Keaton (1989) 

A railroad can be thought of as a network connecting of terminals which send 
freight cars to other terminals in the system. Certain pairs of terminals are 
physically connected by lines of track, as shown in Figure 7.1a. 



There is a fixed cost associated with operating a train. There is also a variable 
cost associated that increases with train size. Because of the level of the fixed costs, 
railroad managers have a powerful incentive to operate long trains. It is not 
generally economical to provide all pairs of terminals with direct train connections, 
and thus many cars must change trains in intermediate terminals, and will 
encounter a considerable amount of delay in the process. The operating plan 
problem, therefore, in essence, is to determine : 

1) which pair of terminals are to be provided with direct train connections. 

2) whether more than one daily train should be operated. 

3) how the individual cars are to be routed through the available configuration 
of trains and intermediate terminals. 

The objective is to minimize the fixed train costs, and car time costs. 

A network structure is used to represent all the combinations of train 
connections and blocking (grouping) alternatives which can be used to move cars 
from origins to destinations. A separate network is required for each origin- 
destination (O-D) pair. The arcs in the network correspond to 1) the available tram 
connection and 2) the interchange of cars between trains in intermediate terminals. 



Let us consider for example cars moving from origin yard A to desitnation yard D in 
the rail system of Figure 7.1a. A possible car flow network for this 0-D pair is shown 
in Figure 7.1b. 


Terminal C 



Fig. 7.1b, Car flow network for 

origin-destination pair (A-D). 

Arc (1, 2) corresponds to one daily train from A to intermediate terminal C. 
Arcs (2, 4), (2, 5), (3, 5), and (3, 4) represent interchange of cars at intermediate 
terminals. Similarly, arc (1, 6) corresponds to one daily direct train from origin yard 
A to destination yard D. The other arcs also have similar interpretations. 

The model is as follows : 

The objective is to determine optimal train connection and car flows so as to 
minimize car and train costs. Hence, the formulation : 


Min cx + dt 
subject to 
Ax = b 
X - rt 5 0 
t€ S 

Here, x is a vector of decision variables corresponding to the arcs available to O D 
pair, and c is the vector of associated costs. Similarly, t represents the vector of 0 1 
decision variables corresponding to the potential train connections in the system, 
and d is a vector of associated costs. 


(7.1a) 

(7.1b) 

(7.1c) 
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Constraint (7.1a) represent the allowable car flow network, where A is the 
node-arc incidence matrix for 0-D pair, and b is the number of cars to be moved. 
Constraint (7.1b) presents cars being assigned to nonavailable trains (say jth for 
which t- = 0). I b'rc x is the car flow variable for 0-D pair associated with its train 
variable (say Xj for train j) and r is the number of cars moved between a particular O 
D pair. Finally, (7.1c) is the relevant constraint on the train variables in set notation. 

The solution strategy using Lagrangian Relaxation is as follows : 

The Lagrangian relaxation is obtained by "dualizing" the set of constraints x - 
rt ^ 0 which link the train variables and car flow variables. Let us associate a vector 
of non-negative multipliers u with it and we get the objective function as : 

min cx -i- dt + u (x - rt) 

Rearranging the terms, we get : 

Z(u) = min (c+u)x + (d-r)t 


(7.1d) 

(7.1e) 


subject to 

Ax = b 
t€ S 

This relaxed problem is easy to solve, since it decomposes into two separate 
problems, one in the x- variables and the other in t-variables. 

The x-variable problem : 

min (c+u)x 
subject to 

Ax = b 

is simply a series of shortest path problems, one for each OD pmr, wi , , „ 

on arcs -Ore author also show that solving the other half of the -l-d problem « 
not computationally burdensome. We can proceed with the x yaria 
using the subgradient optimization technique and can obtain goo 
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Application 7.2 : Delivery Problem 

Reference : Altinkcmer and Vavish (1991) 

The delivery prt)blen\ is one of a group of closely related problems called the 
vehicle routing problem (VRP). It looks for the most economical way to fulfill the 
deterministic transportation requirements of customers by a fleet of vehicles. The 
requirements of customers could be pickup or delivery. Real life applications of the 
delivery problem include delivery of products to supermarkets and departmental 
stores, picking up students by school buses, distribution of newspaper mail or 
laundry and the topological design of local access ring networks. 

Each vehicle lour starts and terminates at the central depot, and the load to be 
delivered at each node is supplied by exactly one vehicle. A set of nodes that is on 
the same tour (i.e., served by the same vehicle) form a cluster. The total delivery 
cost includes operating expenses, fuel and labor. The mathematical formulation is 

presented below : 

n the number of nodes in the problem; 

V the node set of the graph, V = (1 .. n); 

V the node set of the graph excluding root (central depot); 

E the edge set of the graph 

Q the vehicle capacity 

dj the load to be delivered to node i (d^ = 0) 

cjj the cost of travel from node i to node j. 

jl if arc (i j) is traveresed by a vehicle 
Decision variable Xjj =nQ otherwise 

Model 

Minimize Zpp = Z j Cjj Xjj + ^il 


subject to 
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Xj, +Ziii’ Xjj + Xjj = 2 V j = 2 .. n-1 
x„l + S”';X|„=2 (7.2b) 




^es ^<jeS ^ij ^ lSl “ Lg for all S c {2 .. n} 


(7.2a) 


(7.2c) 

(7.2d) 

(7.2e) 


Xjj€ {0, 1), for all i, j 


(7.2f) 


The first and second set of constraints ensure that exactly one vehicle leaves 
and enters from every delivery node. The third constraint set provides a lower 
bound on the number of returning arcs to the central depot and is redundant. 
However, it will be helpful in the Lagrangian relaxation to tighten the lower bound 
on the optimal solution value. Lg is the optimal solution to the bin-packing 

problem (Eilon and Christofides [1971]), when the bin length is Q and D^; ieS are the 
lengths of items to be packed. Constraint (7.2d) follows from the fact that any 
feasible solution must have (n-1) arcs in addition to the arcs directly returning to the 
central depot. Constraint (7.2e) is the subtour elimination constraint and the use of 
this particular form of constraint is made in Lagrangian relaxation. For this, 
constraint set (7.2e) is divided into two subsets 


for all S c (2 .. n), Lg = 1, |S| 2: 2, (7.2ea) 

S ^<je S ^ 1^1"^ 

for all S c {2 .. n}, Lg S: 2, |S| 2: 2, (7.2eb) 

The Lagrangian relaxation L(a, it) is generated by multiplying constraints 
(7.2a), (7,2b) and (7.2eb) with multipliers a = {Oj .. a^} and it = [iti .. a unrestricted 

and 7C S 0. 


L(o, X) = X".; Ij" Ci, Xij + £ ”2 c„ Xi, 
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+ (2 - Xjj^) 

subject to constraints (7.2c), (7.2d), (7.2ea), and (7.2f), where (p represents the set of 
unordered subsets of {2 .. n} with a cardinality greater than 1, such that each subset 
requires more than one vehicle (bin). For a given set of multipliers it and a, L(a, k ) 
is a degree constrained minimal spanning tree (DCMST). Now, one can proceed 
with subgradient optimisation technique to generate good lower bounds for the 
delivery problem. 

Application 7.3 : Capacitated Fixed-charge Minimum Cost Network Flow Problem 

Reference : Khang and Fujiwara (1991) 


The capacitated fixed-charge minimum cost network flow problem arises in a 
variety of real-world applications. The presence of a fixed cost of using an arc in a 
network, in addition to variable cost per unit of flow in the arc, is a familiar 
phenomenon in many transportation, distribution and communication network 
systems. The reference for such applications has been made to the paper by 
Magnanti and Wong (1984), wherein a lot of applications of fixed charge network 
problems as travelling salesman problem, vehicle routing problem, facility location 
problem, network design and traffic equilibrium can be found. 

Let us consider the model formulation of fixed-charge network flow problem. 
Let G (N, A) be a connected and directed graph with node set N = (1 ,.., n} and the arc 
set A. Suppose that each arc (i, j) in A is assigned a fixed charge (nonnegative) s^j, a 
variable cost per unit Cjj, and a positive capacity bjj. For a node i in N, let r^ be the 
fixed requirement at i. The capacitated, single-commodity, fixed-charge network 
flow problem (P) is : 

minimize f(x) = S Cjj Xjj + X Sij8(Xij) 

(i,j)6 A (i,j)e A 


subject to 

(k,i)e A (i,j)e A 


(7.3a) 


0 ^ xjj ^ bij 


A^(l j)€A 


(7.3b) 



where Xjj = flow on arc (i, j) 
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fl if X > 0 

2^ fj = 0, o(z) =|q otherwise 
ieN 


(7.3c) 


It is assumed that the network has a single supply node (denoted as node 1) 
and that all other nodes have positive demands, i.e., < 0 and rj > 0 for i = 2 n. 

Before considering the relaxation scheme, let us exhibit an equivalent formulation 
of P, denoted by Q: 


minimize g(x, y, z) = J c- Xj 

j + X Sjj Tij 


(i,j)c A 

^ (i,j)€A ^ ' 


subject to 

^ki “ .Zj ^ii “ 

■V i = 2 .. n 

(7.3d) 

(k,j)c A (i,j)i A 

bjj Zjj ^ Xjj 5 bjj yjj 

•V(i, j)€ A 

(7.3e) 

yij, ZjjC {0, 1} 

•V(i, j)e A 

(7.3f) 

The equivalence of P and 

Q is obtained by choosing yjj = 5(xjj) and Zjj 

= l-5(bij- 


Xjj) for any feasible st)lution Xjj of P. 


Now, let us denote by u^ (i = 2 n) the Lagrange multipliers, unrestricted in 
sign, corresponding to constraint (7.3d). Then, the relaxed problem is as follows : 

Minimize X (c^ Xj: + Sy ^ X ^ki ' .X ^ij ’ ^ 

(i,j)c A (k,j)eA (i,j)€A 

subject to 

constraints (7.3e) and (7.30 

The authors show that after several modifications of the above, the relaxed 
problem is equivalent to an MST (minimum spanning tree) problem on G, with 
appropriately defined weights. 

Application 7 A : Steiner Problem in Graphs 
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Reference : Beasley (1984) 

It is the problem of connecting together at minimum cost a set of vertices m 
an undirected graph. This problem is NP-complete and therefore tree search 
procedure based on Lagrangian Relaxation is used. The mathematical formulation 
is as : 

Let 


V set of entire vertices 

k set of vertices to be connected together, k^V 
E set of (undirected) edges 

Cjj > 0, cost of edge (i, pe E 


The problem is to choose a subset of E which connects together all the vertices 
in k at minimum cost. 

Let kj = k-1 

fl if edge (i j) is in the solution 
Xij otherwise 


X 



1 if edge (i j) is in 
P otherwise 


the unique path in solution tree from 1 to 


k 


Then, the program is 


[P] 


Minimize 


^ yij 


(i,j)eE 


subject to 


Xij - ^ijk ^ ^ ^ 


Pi ^ yij ^ 

(i/j)€E 

there exists an elementary path (x^^.) from 1 to k V ke Ki 
Xijke(0,l) J/keKi,V (i,j)€E 


(7.4a) 

(7.4b) 

(7.4c) 

(7.4d) 
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Yif (0, 1) 


(7.4e) 


Constraint (7.4a) ensures that an edge is only on some path in the tree if that 
edge is in the solution tree. Constraint (7.4b) limits the number of edges in the 
solution tree, where P| = |K| - 1, Py = |V| -1. Constraint (7.4c) ensures that the 

solution is connected. To develop the lower boimd for the problem [P], we relax 
equation (7.4a) in a Lagrangian fashion. Let Sjjj. be the associated multipliers. Then, 
the relaxed problem (Pj^) is : 


[Pj^] Minimize 

^ ^ ®ijk^ yij ®ijk ^ijk 

(i,j)€E keKj keKj (i,j)eE 


subject to (7.4b) - (7.4e) 

The Lagrangian problem can be easily solved as it decomposes into two 
separate problems, the solution consisting of (i) the calculation in the variables yj's, 
and (ii) |K|| shortest elementary path calculations, finding the shortest path from 

vertex 1 to vertex ke Kj inthe graph with cost matrix Sjjjj. 

Application 7.5 : Star-Star Concentrator Location Problem (SSCLP) 

Reference : Mirzaian (1985) 


It is a network layout problem and is stated as follows. An important 
communication design problem is how to connect several remote terminal sites Tj, 
i = 1 ,.., n to a central (processing) site C^. The usual design method uses 
concentrators. We are given Cj , j = 1 ,.., m, a set of potential concentrator sites which 
is usually a subset of terminal sites, and a subset Ye{c-^ Cj^^} is selected to be the set 
of actual concentrator sites. These concentrators will be connected to the central site 
via high-speed lines. Each terminal must be connected via a low-speed line, to a 
unique site in Yc{Cq}. The number of terminals connected to any Cj€Y must not 

exceed a positive integer k(^) called the concentrator capacity. The cost of installing 
a concentrator at site Cj and connecting it to the central site through a high-speed line 
is dj. The cost of connecting terminal Tj to Cj is Cjj. The optimization problem to find 
a network with minimum cost is called the star-star concentrator location problem 
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(SSCLP). Having defined the problem in this way, the mathematical formulation is 
very easy to state. 

Let, x^j be a binary 0-1 variable denoting whether or not Tj is connected to Cj. 
Similarly, y^ is a binary 0-1 variable denoting whether or not Cj is selected as a 
concentrator site. Then, SSCLP is : 


m min. Ei"i E]!o qj + E^^ d^ y^ 


subject to 


Ejo^j = l = 

(7.5a) 

-Vj = l..m 

(7.5b) 

Xij,yj€{0,l} 

(7.5c) 


The author proposes two Lagrangian relaxations of the problem, by relaxing 
(7.5a) and (7.5b), respectively. The relaxation obtained by relaxing (7.5a) provides 
tighter lower boimds. Hence, relaxed problem, LRj(A,) in vectorial notation is as : 

[LR|(X)1 min. [cx + dy + X.j (1 - E Xjj)] 

= min [ E”, E”^ (^^ - ^j) x^j + E;!, dj y^ E,!, ) 

subject to (7.5b) and (7.5c) of P. 

Next, we state the following result without the proof, which cannot be 
included fully here due to its complexity. The interested readers may, however, 
refer to the original paper by Mirzaian. 

A 

Observation: The problem LRj(X) is equivalent to problem P which is shown 

as 

[P] nun S;. Xj, 

subject to 


i = 1 .. n 


(7.5d) 
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•V j = 1 .. m 

(7.5e) 

>0 

•V i = 1 .. n, j = 0 .. m 

(7.50 

A 




In P , note that the variable yj's have been eliminated. Further, the author 
shows that the problem P is equivalent to another problem P, which is shown as : 

m min z;, Zjoqj Xq 

subject to 


•-» in 

= ai 

i = 1 .. n 


= b, 

j = 1 .. m 

fe>0 


li 

o 

11 


(7.5g) 

(7.5h) 

.. m (7.5i) 


where 


fl ifi = l.. n 
=lkm if i = 0 

fk if j = 1 .. m 
'’iln ifj=0 


Note that the above definition of aj 's and bj's is used to balance the supply 
and demand of two sets of nodes in a transportation problem, after a dummy node 
has been added to each set, one having a supply of km and the other having a 
demand of n. Hence, it is shown finally that the relaxed problem LR|(X) is 
equivalent to a transportation problem with appropriately defined cost, supply and 
demand functions. 


Application 7.6 : Routing in Point-to-Point Delivery Systems 
Reference : Leung, Magnanti and Singhal (1990) 

In a wide variety of large scale delivery systems, a firm must ship goods on a 
network between many origin and destination (OD) pair of nodes. The firm would 
like to specify a cost-effective route for each of the O-D pairs in order to minimize 
overall transportation costs and/or transit times. This type of delivery route 
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planning problem arises in numerous application settings, such as package delivery, 
mail delivery, telephone network design, and rail freight shipping. The delivery 
network consists nodes of two types - terminal nodes and distribution centres (see 
Figure 7.6). 



The required volume of loads to be shipped O-D pair is specified a priori . The 
system incurs two types of costs - shipping costs on each link of the network and the 
processing cost at each node. It should be noted that modeling of shipments between 
O-D pairs has been considered in this paper and not collection/ distribtion of goods 
from/to customers. As an example, in mail delivery, the terminals will correspond 
to local post offices, and the distribution centers to major sorting facilities. 
Therefore, it differs from the typical vehicle routing problem, in which the local 
pickup and delivery is done for end customers. Although there could be many 
operational issues to be handled in such a scenario, the model handles two of those 
1) All goods between the same O-D pair use the same route, and 2) Flows must 
satisfy service requirements, which guarantee delivery within a certain time. The 
authors propose a complex mathematical model and enough justice cannot be done 
by including the mathematical formulation here. We rather give a brief description 
of the model and the solution strategies using Lagrangian relaxation. 

The objective is to minimize shipping cost on each link and processing cost at 
each node. The diferent constraints serve the following purposes. Constraints (1) 
and (5) force each O-D pair to be assigned to a DC (Distribution Center ) - node pair. 
Constraint (2) ensures that the DCs allocate sufficient capacity to cover the volume 
processed. Constraints (3), (4), and (10) ensure that the number of trailers dispatched 
on a link is sufficient to carry the volume on that link. The other constraints take 
care of the connectedness of the network. This particular formulation reflects the 
solution approach via decomposition by considering the routing decisions for each 
O-D pair in two main steps, namely, 1) The assignment of each O-D pair to a (first 
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DC - last DC) pair, and 2) The choice of a route from the first DC to last DC node. The 
model separates the original problem into two linked subproblems. The first 
problem considers the assignment of a first and last DC node on the route for every 
O-D pair. After all such assignments have been made, the second step seeks a 
minimum cost routing of the aggregated flow of goods among the DC nodes. 

In the assignment subproblem, the use of Lagrangian relaxation is made in 
the following way. The solution approach to this problem iterates between a trailer 
allocation problem and an (O-D pair) to (DC pair) assignment problem. First, the 
maximum number of trailers that can be sent on each (O-D pair) - DC link are 
decided. Then, using the Lagrangean approach, the cheapest assignment honouring 
the limit on allowable number of trailers on each link is found out. The trailer 
allocation on several of the (O-D pair) - DC links is adjusted and a compatible 
assignment is tried out again. Finally, after repeating these steps several times, the 
final solution is the one with the minimum overall cost. 

Application 7.7 : Flow Problem with Fixed Charges : Routing Electronic Data 

Reference : Hochbaum and Segev (1989) 

This paper addresses a problem of network design, referred to as a fixed- 
charge problem. The set up for this problem includes a root node from which flow 
is to originate, a collection of nodes all of which have various demands, and the 
directed arcs between all pair of nodes each with two cost figures. One of the costs is 
the fixed cost of using an arc to send flow and the other is the variable cost per unit 
of flow on that arc. The objective is to find minimum cost-set of arcs along which 
the flows from the root to the demand node is to be sent. An application setting is 
in routing messages of electronic data. Here, the root node sends messages at a 
certain point in time addressed to a specific collection of nodes. The use of each arc 
has initial set-up cost asociated with it (such as the siurcharge for the first minute of a 
telephone call) and variable cost per unit of data transmitted. The routing decisions 
are to be made starting at the root node. Then the details of the routing decisions 
can be transmitted with the data. 

Let there be a directed graph G = (V, E), where V is set of n nodes and E is the 
set of m arcs. Each arc (i, j) has fixed cost djj and variable cost Cjj associated with it. 
The graph has one distinguished node from which all flows originate - the 
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source. The other (n-1) nodes V 2 Vj^ have "demand" weights a 2 associated 
with them. Let X|j be the amount of flow on arc (i, j) and yjj is a 0-1 variable which is 
one if Xjj > 0 and zero, otherwise. 

The mathematical formulation is as 


[P] min. E,!, X; 2 CijX 

il + Ki ^A^ijyij 


subject to 



n, n 

^p=l ■ ^q=2 ^ = 

aj 4/' j = 2 ,..., n 

(7.7a) 


a/j = 2,...,n 

(7.7b) 

Ayij>Xij 

^i = l ,..., n, j = 2 ,..., n 

(7.7c) 


i = 1 ,..., n, j = 2 ,..., n 

(7.7d) 

Awij>Xij 

i = 1 ,..., n, j = 2 ,..., n 

(7.7e) 

E;,w,j =1 

Vj = 2,...,n 

(7.7f) 

^aj)esyij - 1^1"^ 

a/SC{l, .., n} 

(7-7g) 

^(io)es'^ij ^ 1S|-1 

A^SC{1, .., n) 

(7.7h) 

Wjj€ {0, 1}, yije {0, 1}, 

, Xjj > 0 V i = 1 ,..., n, j = 2 ,..., n 

(7.7i) 

Here, A = Ej "2 aj is total flow originating from source. 

Wjj has the same 


interpretation as though it does not appear in the objective function. 


Constraints (7.7a) represent flow balance constraint; constraints (7.7b) ensure 
that exactly one arc will enter each node (except node 1); constraints (7.7c) guarantee 
that if yjj = 0, no flow will occur between node i and node j. This formulation is in 

fact an augmented formulation of a typical fixed charge problem. The formulation 
has been augmented by adding a set of redundant constraints. Though redundant in 
this formulation, the additional constraints (7.7d) through (7.7h) help to generate 
tighter lower bounds via Lagrangian relaxation. Constraints (7.7g) and (7.7h) are 
typical cycle prevention constraints. The Lagrangian relaxation is proposed by 
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relaxing these constraints by associating non-negative multiplier vectors z and X, 
with them, respectively. Then, we get the relaxed problem as : 

[Pr] min 2:j!2^ijyij) 

subject to (7.7a), (7.7b), (7.7e) - (7.7i) 

where Cjj = qj + Zj^ - and djj = djj + a^ X^^ - Azj^ 

The relaxed problem has a nice property that it is decomposable into two 
simpler subproblems. The first is a minimum branching rooted at node 1 (with 
reference to y^) and the second problem is a minimum tree-flow problem (with 
reference to Wjj and Xjj ). The solution of the tree-flow problem is obtained by 
finding shortest paths fom node 1 to all other nodes. 

Application 7.8 : Application of Lagrangian Decomposition to Resource Constrained 
Minimum Weight Arborescence Problem. 

Reference : Guignard and Rosenwein (1990) 

This is an extension of the well-known network design problem, and is also 
known as directed minimum spanning tree problem. It arises frequently in the 
design of a hierarchial distribution network in which finite resources, pertinent to 
distribution, exist at each vertex. 


An arborescence, rooted at S, is a connected partial graph G' = (V, B) of G = (V, 
A) where B^A {V is the set of vertices and B, A are set of arcs). Let = 1 if xe B and 
0, otherwise. Among the properties characterizing an arborescence are that 1) each 
vertex except S has an indegree of exactly one; 2) it has (n-1) arcs; 3) it contains no 
circuits; 4) a unique path exists from s to every je V’, where V = V-{s}. If each arc (i, 
j) has an associated weight, Cjj, the weight of the an arborescence B emanating from s 

The problem ming Cjj represents the minimum weighted 
(i,j)€ B (i,j)€ B 

arborescence (MW A) problem. 


[P] 


Min 


(i,j)6 A 


Cij Xij 


subject to 
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J/ jeV 

(7.8a) 

iGP(j) 

G' contains no circuits 


(7.8b) 

2 ajj Xjj < bj. 

^ ieV 

(7.8c) 

jeQ(i) 

Xjj = 0 or 1, 

^ (i,j)eA 

(7.8d) 


Here, 


P(j) set of predecessors of node j. 

Q(i) set of successors of i 

ajj amount of resource associated with traversing an arc (i, j) 
bj fixed amount of resource at each vertex ’i'. 


The presence of (7.8c) implies that the problem is NP-hard. Therefore, a 
redundant constraint (8.8e) Xjj = y^j is added to the problem and the decision 

variables in (7.8c) are reframed from x to y. Associating multiplier vector u with 
(7.8e) and relaxing it in a Lagrangian fashion yields two subproblems - one an MWA 
problem and the other a set of n independent knapsack problems. 


Min^ 


^ (Cij + Ujj) Xjj 
(i,j)€A ^ 


subject to 


S Xij 
ieP(j) 


= 1 , 


W jeV 


G’ contains no circuits 


(7.8e) 


Xjj = 0 or 1, 


^ (i,j)6A 


(7.8f) 

(7.8g) 
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Maxy ^ UijYij 

(i/j)e A 


subject to 


S yij ^ bj, 

j6Q(i) 

ieV 

(7.8h) 

yj. =0orl. 

V (i,j)eA 

(7.8i) 


Prj can be solved efficiently as a minimum spanning tree problem, with cost 
vector as (qj + Ujj). 

Application 7.9 : Designing Minimal Spanning Tree Network Subject to a Budget 
Constraint 


Reference : Jornsten and Migdalas (1988) 

The problem of determining a minimal spanning tree (MST) subject to side 
constraints arises frequently in practice, generally in the design of computer 
communication networks, and pipeline systems. The inherent structure of the side 
constraints may vary for different applications, thereby defining a whole family of 
constrained minimal spanning tree problems. The well known degree constrained 
MST, capacitated MST, resource constrained MST, and the MST subject to flow 
requirements, all belong to this class of problem and can be described in terms of a 
generic model. The model and the notations are as follows : 

Let G (N, A) be a graph with N as set of nodes and A as set of arcs. Let node 1 
be distinguished from the rest of the nodes. We assume that every node, except 
node 1, generates 1 unit of flow. Node 1 is designated as sink. Hence, the problem is 
to connect N nodes of the network in the most cost-efficient way, while at the same 
time preserving the tree topology of the solution and satisfying the budget 
constraint. This problem P| can be stated as follows : 

[Pll 

inir^(i,j)€Afijyij (7.9a) 


subject to 
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S 

jeN(i,j)eA 




■. S ’■s 

jeN(l,j)eA 


1 if i=k 

-1 ifi=l A^ieN, ¥keN-{l} 
, 0 otherwise 


>0 

yije{0,l) 

X yij=i 

(jeN)( (i,j)€A)' 


Y(i,j)€A. VkeN-{l} 
^ (i,j)e A, V keN-{l} 
W a, ])e A 
VieN-{l} 


S 

(i,j)eA 


ai,yi,£b 


(7.9b) 

(7.9c) 

(7.9d) 

(7.9e) 

(7.9f) 

(7.9g) 


Here, fjj is the cost of including the arc (i, j) in the solution. The binary 
variable yjj represents the choice of whether to include the arc (i, j) in the solution 
or not, and the continuous variables x represent the flow generated at node k which 
passes through arc (i, j). The constraint (7.9b) are the well known equations for 
flow conservation. Constraints (7.9c) imply that an arc is only open for traffic if it 
has been constructed. The out-degree constraint (7.9f) ensure the tree-like structure 
and constraint (7.9g) is the budget restriction. 


By introducing auxiliary variables Zjj and I A I constraints the 

following problem equivalent to results : 


[PJ 


min a I fijyij + P I 

(l,j)eA ’ (l,j)eA 

(7.9h) 

subject to (7.9b) - (7.9f) 


S aijZij<b 

(l,j)6 A ^ ' 

(7.9i) 

ZijS {0,1} Y (i,j)eA 

(7.9j) 

= zjj Y (i, j)e A 

(7.9k) 
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Here a and P are prefixed multipliers such that a + p = 1. 

Two Lagrangian relaxation proposals are presented, one each corresponding 
to both Pj and P 2 . 

By relaxing the budget constraint (7.9g), problem P^ reduces to the following 
MST-subproblem : 

v(MST; p) = min (fij+ (7.91) 


subject to (7.9b) - (7.9f) 

The solution of this problem can easily be obtained by applying any 
minimum spanning tree algorithm. 

Corresponding to P 2 , the Lagrangian relaxation of constraints (7.9k), separates 
the problem into one (x, y)-part and one z-part, resulting in the following 
subproblem : 

v(MST; X,) = min X (« ^ii + ^pyii (7.9m) 

(i,j)€A ^ ' 

subject to (7.9b) - (7.9f) 
and 


v(KNPSK; X) = min 

(i,])eA ' ^ ^ 

(7.9n) 

subject to 



(i,j)g a ’ ^ 


(7.9p) 

2ij€ {0,1} 

^ (i,j)€A 

(7.9q) 


Subproblem (7.9m) is a minimal spanning tree subproblem and subproblem 
(7.9n) is a zero-one knapsack problem. 

Application 7.10 : Routing for Circuit Data Networks 


Reference : Yee and Lin (1992) 
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In virtual circuit networks, the data packets are considered for transmission 
between a set of origin - destination (O-D) pairs. All the packets in a session are 
transmitted over exactly one path established between the O-D pair. For each 0~D 
pair, it is assumed that there are multiple sessions. The main motivation for using 
this type of service is that all the packets arrive at the destination in the order in 
which they are sent. The problem is to choose a path for each session so as to 
minimize the packet delay in the network. The problem is formulated as a 
multicommodity flow problem. Because of the complexity of the mathematical 
model, it cannot be included here in totality. The scheme of the usage of the 
Lagrangean relaxation is as follows. The capacity of each link in the network is 
limited and it represents a hard constraint in the model. When this capacity 
constraint is relaxed in a Lagrangean fashion, the problem divides in two 
subproblems. Subproblem 1 is composed of I L I (one for each link I ) simple 
problems. Each of such problems is easily solvable by minimization of a convex 
function. Subproblem 2 composes of I W I (one for each O-D pair w) independent 
problems, each involving the rearrangement of the distribution of the sessions 
among the available route sets. The authors show that the above is equivalent to 
solving a shortest path problem for each O-D pair. The interested readers are 
referred to the original paper for more detailed description of the model and the 
solution procedure by Lagrangean relaxation and subgradient optimization. 
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CHAPTER 8 

CONCLUSIONS AND DIRECTION FOR FUTURE RESEARCH 

Through the appreciation of the applications presented in the previous 
chapters, we observe that Lagrangian relaxation emerges as a flexible solution 
strategy that permits the modelers to exploit the underlying structure in any 
optimization problem by relaxing complicating constraints. Usually, such 
constraints are chosen to relax that furnish a Lagrangian subproblem which is much 
easier to solve than the original problem. 

The applications in this work encompass several important network 
optimization models: networks with side constraints, the traveling salesman 
problem, vehicle routing, personnel planning, degree-constrained minimum 
spanning trees, and production planning, etc. As we have seen, these optimization 
models have applications in such diverse settings as communication systems 
design, crew scheduling, logistics, production, workforce scheduling, and 
multilocation facility modernization, etc. Consequently, this work illustrates the 
broad applicability of Lagrangian relaxation across many practical problem contexts 
and demonstrates the ability of network flows to model an extraordinarily wide 
range of problems met in practice. Therefore, it appears pertinent at this stage to 
categorize these applications according to the problem context, thus providing a 
reference schema for the readers interested in a specific problem context. We 
provide the following broad classification:- 



Manufacturing, Production and Inventory Planning 
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1) Multi-item capacitated lot sizing problem. ( Application 3.10) 

2) Allocation of inspection effort on a production line. (Application 3.11) 

3) Repair kit selection problem with limits on annual inventory budget. 

(Application 4.4) 

4) Repair kit selection problem subject to a budget constraint. 

(Application 4.5) 


5) Operations sequencing in discrete parts manufacturing. 

(Application 4.1) 


Scheduling 

1) Crew scheduling in a mass transit setting. (Application 3.3) 

2) Rotating workforce scheduling. (Application 3.6) 

3) Rotating workforce scheduling : additional applications. 


4) Scheduling of power generation systems. 

5) Multi-depot vehicle scheduling problem. 

6) Scheduling daily operations in a steel rolling mill. 


(Application 3.7) 
(Application 3.9) 
(Application 6.3) 
(Application 6.5) 


Social Sciences, Public Policy and Management Science 

1) Rostering problem. 

2) Capital budgeting with side constraints. 

3) Capital budgeting with threshhold constraint. 

4) Forest scheduling problem. 


(Application 3.4) 
(Application 4.2) 
(Application 4.3) 
(Application 4.7) 


5) Manpower planning problem with attrition constraint. 
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6) Manpower planning problem with budget constraint. 

7) Personnel assignment in armed forces. 

Computer Science and Communication Systems 

1) VLSI circuit design. 

2) Survivable network design testing. 

3) Multilocation facility modernization. 

4) Concentrator location problem. 

5) Routing electronic data. 

6) Routing for circuit data networks. 

Distribution and Transportation 

1) Selecting freight handling terminals. 

2) Routing of container ships. 

3) Designing optimal railroad operating plan. 

4) Delivery problem. 

5) Routing in point-to-point delivery system. 


(Application 5.2) 

(Application 5.3) 
(Application 6.6) 

(Application 3.1) 
(Application 3.2) 
(Application 5.1) 
(Application 7.5) 
(Application 7.7) 
(Application 7.10) 

(Application 4.6) 
(Application 5.4) 
(Application 7.1) 
(Application 7.2) 
(Application 7.6) 



;matics anc 


)retical 


Lications 


1) Resource constrained shortest path problem. 

2) Travelling salesman problem (TSP). 


3) Network flow problems with variable upper bounds. 


4) Multicommodity flow problem. 

5) Set partitioning problem. 

6) Equal flow problem. 

7) Node-weighted Steiner tree problem. 

8) Lagrangian approach to TSP. 

9) Maximum collection problem. 

10) Prize collecting TSP. 

11) Capacitated fixed-charge network flow problem. 

12) Steiner problem. 

13) Constrained arborescence problem. 

14) Minimal spanning tree with budget constraint. 


(Application 3.5) 
(Application 3.8) 

(Application 5.5) 
(Application 5.6) 
(Application 5.7) 
(Application 5.8) 
(Application 5.9) 
(Application 6.1) 
(Application 6.2) 
(Application 6.4) 
(Application 7.3) 
(Application 7.4) 
(Application 7.8) 
(Application 7.9) 


In this classification, we have placed each application in a single category, 
thus reflecting the application's primary context. It is possible that several of these 
applications may fit into several of the categories. Our classification, however, does 
not depict any such overlaps. 


This report serves several purposes. For the first time, it collects all such 
applications that are network flow problems with additional side contraints. These 
applications demonstrate the use of Lagrangian relaxation technique to solve such 
hard problems. As mentioned in the introduction given in Chapter 1, this work is 
in continuation of a project done last year on the same topic. Therefore, there is a 
similarity in the approach adopted in both the works; however, the applications 
searched by both are non-overlapping. A synthesis of both the works, therefore, will 



provide over 80 different applications in varied contexts. Thus, such a work shall 
prove to be of great use to teachers who may include some of these in their courses 
on network/combinatorial optimization. We believe that the appreciation of the 
models described in this work will motivate the researchers to identify more and 
more hard optimization problems that can be solved by efficient network flow 
algorithms using Lagrangian relaxation. Additionally, as a direction for future 
research, a computational investigation strategy is being contemplated that 
compares the Lagrangian relaxation based solution technique with other techniques 
available to solve constrained network flow problems. Any such solution technique, 
Lagrangian relaxation based or otherwise, may be tested on a variety of constrained 
network flow problems ( randomly generated as well as derived from real-life 
situation) and with varying number of constraints. The results obtained from such a 
study shall validate the use of Lagrangian relaxation as a strong algorithmic tool for 
solving hard optimization problems. 
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